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Abstract. These lectures present an overview of the current status of the QCD based 
phenomenology for open and hidden heavy flavor production at high energies. A uni- 
fied description based on the light-cone color-dipole approach is employed in all cases. 
A good agreement with available data is achieved without fitting to the data to be 
explained, and nontrivial predictions for future experiments are made. The key phe- 
nomena under discussion are: (i) formation of the wave function of a heavy quarkonium; 
(ii) quantum interference and coherence length effects; (iii) Landau-Pomeranchuk sup- 
pression of gluon radiation leading to gluon shadowing and nuclear suppression of heavy 
flavors; (iv) higher twist shadowing related to the finite size of heavy quark dipoles; 
(v) higher twist corrections to the leading twist gluon shadowing making it process 
dependent. 

1 Introduction 

Reactions in which heavy flavors are produced involve a hard scale that allows 
one to employ perturbative QCD (pQCD). In particular, production off nuclei 
has always been an important topic in heavy quark physics. On the one hand, 
interest in this field is stimulated by demand to provide a proper interpreta- 
tion for available and forthcoming data, especially from heavy ion collisions. On 
the other hand, nuclei have been traditionally employed as an analyzer for the 
dynamics and time scales of hadronic interactions. 

In these lectures, we shall review the color dipole formulation of heavy flavor 
production, which was developed in [1-4]. The dipole approach to heavy flavor 
production expresses the cross section for production of open or hidden heavy 
flavor in terms of the cross section for scattering a color neutral quark- antiquark 
(qq) pair off a nucleon. This approach is motivated by the need for a theoretical 
framework for the description of nuclear effects. Its main distinction from the 
conventional parton model is the possibility to actually calculate nuclear effects 
in the dipole formulation, rather than absorbing them into the initial conditions. 
In addition, the dipole approach is not restricted to the leading twist approxima- 
tion. This is especially important for nuclear effects in J /if) production, which 
are dominated by higher twists. Another advantage of the dipole approach is 
that it correctly describes the absolute normalization of cross sections in dif- 
ferent processes, without introducing an arbitrary overall normalization factor 
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( "K- factor" ) [5,6]. However, the dipole approach is applicable only in the kine- 
matical domain, where the heavy quark mass uiq is much smaller than the center 
of mass (cm.) energy yfs. The latter condition is fulfilled for charm production 
at the BNL Relativistic Heavy Ion Collider (RHIC) and for both, charm and 
bottom production, at the CERN Large Hadron Collider (LHC). 

An alternative approach to heavy quark production that is designed espe- 
cially for high energies and which is able to describe nuclear effects is desirable 
for a variety of reasons. At low x, the heavy quark pair is produced over large 
longitudinal distances, which can exceed the radius of a large nucleus by or- 
ders of magnitude. Indeed, even though the matrix element of a hard process is 
dominated by short distances, of the order of the inverse of the hard scale, the 
cross section of that process also depends on the phase space element. Due to 
gluon radiation, the latter becomes very large at high energies, and it is still a 
challenge how to resum the corresponding low- a; logarithms. The dipole formu- 
lation allows for a simple phenomenological recipe to include these low- a; logs. 
The large length scale in the problem leads to pronounced nuclear effects, giving 
one the possibility to use the nuclear medium as microscopic detectors to study 
the space-time evolution of heavy flavor production. 

In addition, heavy quark production is of particular interest, because this 
process directly probes the gluon distributions of the colliding particles. Note 
that at the tremendous center of mass energies of RHIC and LHC, charm (and 
at LHC also bottom) decays will dominate the dilepton continuum [7]. Thus, 
a measurement of the heavy quark production cross section at RHIC and LHC 
will be relatively easy to accomplish and can yield invaluable information about 
the (nuclear) gluon density [8]. It is expected that at very low x, the growth of 
the gluon density will be slowed down by nonlinear terms in the QCD evolution 
equations [9]. The onset of this non- linear regime is controlled by the so-called 
saturation scale Q s (x, A), which is already of order of the charm quark mass at 
RHIC and LHC energies. Moreover, Q s (x, A) oc A 1 / 3 (A is the atomic mass of the 
nucleus) , so that one can expect sizable higher twist corrections in AA collisions 
[4]. Note that saturation will lead to a breakdown of the twist expansion, since 
one cannot conclude any more that terms suppressed by powers of the heavy 
quark mass mg are small, Q™(x, A)/m,Q € 0(1) for any n [10]. Saturation effects 
are most naturally described in the dipole picture. 

The most prominent motivation for a theoretical investigation of nuclear ef- 
fects in heavy flavor production is perhaps the experimentally observed suppres- 
sion of J/ij) mesons in nuclear collisions, see Ref. [11] for a review. Suppression of 
J/tjj production in nucleus- nucleus (AA) collisions has been proposed as signal 
of quark-gluon plasma (QGP) formation [12]. There are however several "mun- 
dane" nuclear effects that also lead to J/tp suppression, such as gluon shadowing, 
final state absorption and breakup due to interactions with comovers. This issue 
has been widely and controversially discussed in the literature, and one clearly 
needs a reliable theoretical description of all these effects, before definite con- 
clusions about any non-standard dynamics in heavy ion collisions can be drawn. 
Since the creation and study of the QGP is the main physics motivation for 
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RHIC, the theoretical investigation of nuclear effects in J/tp production is at 
the heart of the RHIC heavy ion program. Note that the production mechanism 
for heavy quarkonia itself is poorly understood, even in proton-proton (pp) colli- 
sions. However, since heavy flavors can be produced in many different reactions, 
and one may hope that a detailed experimental and theoretical study of quarko- 
nium production in different environments and over a wide kinematical range 
will eventually clarify the underlying production mechanism. 

2 The foundations of the color dipole approach to high 
energy scattering 

It was first realized in [13] that at high energies color dipoles with a well defined 
transverse separation are the eigenstates of interaction at, i.e. can experience only 
diagonal transitions when interacting diffractively with a target. The eigenvalues 
of the amplitude operator are related to the cross section cr qq -(r) of interaction 
of a qq dipole with a nucleon. This dipole cross section is a universal, flavor 
independent quantity which depends only on transverse qq separation. Then, 
the total hadron (meson) nucleon cross section can be presented in a factorized 
form, 



where &qq(r) is the light-cone wave function of the qq component of the hadron. 
It was assumed in [13] that \&qq{r)\ 2 is integrated over longitudinal coordinate. 

One of the advantages of this approach is simplicity of calculation of the ef- 
fects of multiple interactions which have the cikonal form (exact for eigenstates) , 



where Ta(&) is the nuclear thickness function which depends on impact param- 
eter b. 

Later the energy dependence of the dipole cross section was taken into ac- 
count [14], and was found that one can apply the same color-dipole formalism to 
variety of QCD processes, including radiation [15]. Here we review this approach 
applied to production of heavy flavors. 

The simplest example for heavy flavor production is open heavy quark pro- 
duction in deep inelastic scattering (DIS) off a proton, which can be measured 
at the DESY ep collider HERA. We use this example to explain the basic ideas 
underlying the color dipole approach to high energy scattering. 

The dipole approach is formulated in the target rest frame, where DIS looks 
like pair creation in the gluon field of the target, see Fig. 1. For further simplifi- 
cation, we consider only the case of a longitudinally polarized 7* with virtuality 
Q 2 in this section, since the transverse polarization does not contain any qualita- 
tively new physics. A straightforward calculation of the two Feynman diagrams 
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Fig. 1. Perturbative QCD graphs for heavy quark (QQ) production in DIS. The virtual 
photon (y*) fluctuates into a (virtual) QQ-pair far before the target. The interaction 
with the target, which is denoted by gluon (G) exchange, can put this fluctuation on 
mass shell. 



in Fig. 1 yields for the transverse momentum (k±) distribution of the heavy 
quark [16], 



d<r {llP -> {QQ}X) Aa cm a s e 2 Q Q 2 f 2 

= - / da a (1 - a) 

1" J 



d 2 K± 



d 2 k T 



i 2 + e 2 , - i-^ 2 -J- <r2 



(k± - fer) + e 2 



T(x,k 2 )(3) 



where a is the light-cone momentum fraction of the heavy quark and e 2 = 
a (1 — a) Q 2 + ttiq. The quark electric charge is denoted by eQ] a em = 1/137 
and a s are the electromagnetic and the strong coupling constants, respectively. 
The QQ-pair exchanges a gluon with transverse momentum k T with the target. 
The latter is characterized by the unintegrated gluon density F{x, fcf,). Note 
that Eq. (3) is also valid for light flavors. 

In the dipole approach, a mixed representation is employed, that treats the 
longitudinal (7*) direction in momentum space, but the two transverse directions 
are described in coordinate {i.e. impact parameter) space. With help of the 
relation 

1 r d 2 - 



n 2 +e 2 



^K (er)e- 



(4) 



where K is the zeroth order MacDonald function [17], one can Fourier transform 
Eq. (3) into impact parameter space, 



do_ (llP ^ {QQ}X) 
d 2 K± 



1 



da / d 2 nd 2 r 2 e iK ^ ri - r ^ 



(2tt) 2 

x ^Qo(a,ri)S^ g<5 (a,r 2 ) 

X \{<rqq(n,x) + CT q q{r 2 ,x) - (T g q{ri - r 2 ,x).} (5) 

Since the are conjugate variables to one can interpret r*i as the transverse 
size of the QQ-pair in the amplitude and r 2 as the size of the pair in the com- 
plex conjugate amplitude. An expression similar to Eq. (5) was also obtained in 
Ref. [18]. 
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The light-cone (LC) wavefunctions for longitudinal (L) and for transverse 
(T) photons are given by 



^^ QQ (a, ri )^ QQ (a,r 2 ) = ^R^a 2 (1 - a) 2 K (s ri )Ko(sr 2 ) (6) 

6a eni e% 



rp rp UCtQm C-/Q I „ 



+ 



+ (l-a) 2 ] '^Kp T;:Kp | 



)}(-7 



The concept of LC wavefunction of a photon was first introduced in Refs. [19,20]. 
These wavefunctions are simply the 7* — > QQ vertex times the Feynman propa- 
gator for the quark line in Fig. 1, and can therefore be calculated in perturbation 
theory. 

The flavor independent dipole cross section a qq in Eq. (5) carries all the 
information about the target. It is related to the unintegrated gluon density by 
[21] 

i(r,x) = ^ [ ^a s T(x,k T ){l-c- ik - r }. (8) 



The color screening factor in the curly brackets in Eq. (8) ensures that o- qq (r, x) 
vanishes oc r 2 (modulo logs) at small separations. This seminal property of the 
dipole cross section is known as color transparency [13,22,23]. The dipole cross 
section cannot be calculated from first principles, but has to be determined 
from experimental data, see sect. 3. In principle, the energy, i.e. x, dependence 
of o~ q q could be calculated in pcrturbativc QCD. This has been attempted in 
the generalized BFKL approach of Nikolaev and Zakharov, see e.g. [21], by 
resumming higher orders in perturbation theory. However, the widely discussed 
next-to-leading order (NLO) corrections to the BFKL equation [24,25] has left 
the theory of low- a; resummation in an unclear state. We shall account for higher 
order effects by using a phenomenological parameterization of the dipole cross 
section. 

In the high energy limit, one can neglect the dependence of the gluon mo- 
mentum fraction x on n± and integrate Eq. (5) over k± from to 00. One then 
obtains a particularly simple formula for the total cross section, 

fftot {l*P^{QQ}X)=Y^ [da f d 2 r\^ QQ (a, ri )\ 2 a q q(r,x). (9) 

It was argued in Ref. [26] that the dipole formulation is valid only in the leading 
log(x) approximation where Eq. (9) holds. Note however that Eq. (5) docs not 
rely on any high energy approximation and is exactly equivalent the the kr~ 
factorized expression Eq. (3). 

Eq. (9) has an illustrative interpretation, which is the key to calculating 
nuclear effects in the dipole approach: The total cross section can be written 
in factorized form in impact parameter space, because partonic configurations 
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with fixed transverse separations are eigenstates of the interaction [13,27], i.e. 
of the T matrix restricted to diffractive processes. Intuitively, the transverse size 
is frozen during the entire interaction because of time dilation. In the dipolc 
approach, the projectile is expanded in these eigenstates, 

i7*)-E c ^>' ( 10 ) 

k 

with 

-iT|Vfc) =a k \tp k ). (11) 

Each eigenstate scatters independently off the target. According to the optical 
theorem, the total cross section is then given by 

<7tot=Im< 7 *|T| 7 '>=$>Z* \ 2 a k . (12) 

k 

Comparing this expression, Eq. (12), with Eq. (3), one can identify <J q q(r, x) as 
an eigenvalue of the T-matrix and the coefficients cj. as LC wavefunctions. The 
summation over the index k is replaced by the integrals over a and r. 

Knowing the eigenstates of the interaction is a great advantage in calculating 
multiple scattering effects in nuclear collisions. Note however that the quark- 
antiquark pair is only the lowest Fock component of the virtual photon. There 
are also higher Fock states containing gluons, which are not taken into account 
by these simple considerations. These gluons cause the x-dependence of the 
dipole cross section and will be included in a phenomenological way, see sect. 3. 
In addition, at lower energies color dipoles are no longer exact eigenstates. A 
dipolc of size r± may evolve into a dipole of a different size r^- This can be 
calculated from Eq. (5). 



3 The phenomenological dipole cross section 

The total cross sections for all hadrons and (virtual) photons are known to rise 
with energy. It is obvious that the energy dependence cannot originate from the 
hadronic wave functions, but only from the dipole cross section. In the approx- 
imation of two-gluon exchange used in [13] the dipole cross section is constant, 
the energy dependence originates from higher order corrections related to gluon 
radiation. Since no reliable way is known so far to sum up higher order correc- 
tions, especially in the semihard regime, we resort to phenomenology and employ 
a parameterization of <7 q q(r, x). 

Few such parameterizations are available in the literature, we choose two of 
them which are simple, but quite successful in describing data and denote them 
by the initials of the authors as "GBW" [28] and "KST" [29]. 

We have 

"GBW" : <j qq -(r, x) = 23.03 [l - e ~ r2 ' r ^ x A mb , (13) 

/ v 0.144 

r (x) = 0.4 l±\ fm , 
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where x = 3.04 • 1CT 4 . The proton structure function calculated with this pa- 
rameterization fits very well all available data at small x and for a wide range of 
Q 2 [28]. However, it obviously fails describing the hadronic total cross sections, 
since it never exceeds the value 23.03 mb. The x-dependence guarantees Bjorken 
scaling for DIS at high Q 2 , however, Bjorken x is not a well defined quantity in 
the soft limit. 

This problem as well as the difficulty with the definition of x have been 
fixed in [29], where the dipole cross section is treated as a function of the cm. 
energy y/s, rather than x, since y/s is more appropriate for hadronic processes. 
A similarly simple form for the dipole cross section is used 

"KST": <r q q(r,s) = a (s) [l-e^W] . (14) 

The values and energy dependence of hadronic cross sections is guaranteed by 
the choice of 

»»m= 2 K£) { 1+ lm mb ' (15) 

\-0.14 

S 



r Q (s) = 0.88 ^— J fm . (16) 

The energy dependent radius ro(s) is fitted to data for the proton structure func- 
tion F%(x, Q 2 ), so = 1000 GeV 2 and the mean square of the pion charge radius 
( r ch) = 0.44 fm 2 . The improvement at large separations leads to a somewhat 
worse description of the proton structure function at large Q 2 . Apparently, the 
cross section dependent on energy, rather than x, cannot provide Bjorken scaling. 
Indeed, the parameterization Eq. (14) is successful only up to Q 2 w 10 GeV 2 . 

In fact, the cases we are interested in, charmonium production and interac- 
tion, are just in between the regions where either of these parameterization is 
successful. Therefore, we suppose that the difference between predictions using 
Eqs. (13) and (14) is a measure of the theoretical uncertainty which fortunately 
turns out to be rather small. 

We demonstrate in Fig. 2 a few examples of r 2 -dependencc of the dipole 
cross section at different energies for both parameterization. Both, GBW and 
KST cross section, vanish oc r 2 at small r, but deviate considerably from this 
simple behavior at large separations. 

Quite often, the simplest parameterization (oc r 2 ) is used for the dipole cross 
section. For the coefficient in front of r 2 we employ the expression obtained by 
the first term of the Taylor expansion of Eq. (14): 



We shall refer to this form of the dipole cross section as r 2 -approximation. 
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Fig. 2. The dipole cross section as function of r% at energies ^/s — 10, 30, 100 and 
300 GeV for GBW (left) and KST (right) parameterizations. In the left panel, we used 
the prescription of [30], x = (M^ + Q 2 )/ s, where is the charraoniura mass. 

4 Diffractive photoproduction of charmonia off protons 

The dynamics of production and interaction of charmonia has drawn attention 
since their discovery back in 1974 [31]. As these heavy mesons have a small 
size it has been expected that hadronic cross sections may be calculated relying 
on perturbative QCD. The study of charmonium production became even more 
intense after charmonium suppression had been suggested as a probe for the 
creation and interaction of quark-gluon plasma in relativistic heavy ion collisions 
[12]. 

Since we will never have direct experimental information on charmonium- 
nuclcon total cross sections one has to extract it from other data for example 
from elastic photoproduction of charmonia 7p — ► Jfip(ip') p. The widespread 
believe that one can rely on the vector dominance model (VDM) is based on 
previous experience with photoproduction of p mesons. However, even a disper- 
sion approach shows that this is quite a risky way, because the J/0 pole in the 
complex Q 2 plane is nearly 20 times farther away from the physical region than 
the p pole. The multichannel analysis performed in [32] demonstrates that the 
corrections are huge, <7^f p turns out to be more that three times larger than 
the VDM prediction. Unfortunately, more exact predictions of the multichannel 
approach, especially for ip', need knowledge of many diagonal and off-diagonal 
amplitudes which are easily summed only if one uses the oversimplified oscillator 
wave functions and a qq-proton cross section of the form a qq -(r) cx r 2 , where r is 
the transverse qq separation. 

Instead, one may switch to the quark basis, which should be equivalent to the 
hadronic basis because of completeness. In this representation the procedure of 
extracting a^f p from photoproduction data cannot be realized directly, but has 
to be replaced by a different strategy. Namely, as soon as one has expressions for 
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Fig. 3. Schematic representation of the amplitudes for the reactions 7*p — > ipp (left) 
and ipp elastic scattering (right) in the rest frame of the proton. The cc fluctuation of 
the photon and the ip with transverse separation r and cm. energy y/s interact with 
the target proton via the cross section a(r,s) and produce a J/tp or ip' . 



the wave functions of charmonia and the universal dipole cross section a q q(r 7 s), 
one can predict both, the experimentally known charmonium photoproduction 
cross sections and the unknown a'^f^ • )p . If the photoproduction data are well 
described one may have some confidence in the predictions for the cr^f^ ^ p . 
Of course this procedure will be model dependent, but we believe that this is 
the best use of photoproduction data one can presently make. This program 
was performed for the first time in [33]. We do not propose a conceptually new 
scheme here, but calculate within a given approach as accurately as possible and 
without any free parameters. Wherever there is room for arbitrariness, like forms 
for the color dipole cross section and those for for charmonium wave functions, 
we use and compare other author's proposals, which have been tested on data 
different from those used here. 

In the light-cone dipole approach the two processes, photoproduction and 
charmonium- nuclcon elastic scattering look as shown in Fig. 3 [33]. The corre- 
sponding expressions for the forward amplitudes read 

l 

M rp (s 1 Q 2 )=Y J fda f d 2 r^\a,r)a q ,(r, S )^ ) (a 1 r,Q 2 ) , (18) 
l 

M* p {8) =]T [da I ' d 2 r^\a,r)a qq (r,s)^\a,r) . (19) 

Here the summation runs over spin indexes Ji of the c and c quarks, Q 2 is 
the photon virtuality, <? 7 * (a, r, Q 2 ) is the light-cone distribution function of the 
photon for a cc fluctuation of separation r and relative fraction a of the photon 
light-cone momentum carried by c or c. Correspondingly, <P^(a,r) is the light- 
cone wave function of J/0, 0' and \ (only in Eq. 19). The dipole cross section 
c 9 q(r, s) mediates the transition (c/ Fig. 3). 

The light cone variable describing longitudinal motion which is invariant to 
Lorentz boosts is the fraction a = /pt, of the photon light-cone momentum 
pi, = Ej* +p r * carried by the quark or antiquark. In the nonrelativistic approx- 
imation (assuming no relative motion of c and c) a = 1/2 (e.g. [33]), otherwise 
one should integrate over a (see Eq. (18)). For transversely (T) and longitudi- 
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nally (L) polarized photons the perturbative photon-quark distribution function 
in Eq. (18) reads [19,20], 



4"f (a,r,Q>) = VI ": aem Z cX rtd T , L xlK (er) , (20) 

Z 7T 

where 

Xc = iVyX*c\ (21) 

X and x are the spinors of the c-quark and antiquark respectively; Z c = 2/3. 
K (er) is the modified Bessel function with 

e 2 = a{\ - a)Q 2 + ml . (22) 

The operators Ot,l have the form: 

Ot — m c <j ■ e 7 + i(l — 2a) (er ■ n) (e 7 • V r ) + (n x e 7 ) • V r , (23) 
6 L = 2ga(l-a)cr-n , (24) 

where n = p/p is & unit vector parallel to the photon momentum and e is the 
polarization vector of the photon. Effects of the non-perturbative interaction 
within the qq fluctuation are negligible for the heavy charmed quarks. 



4.1 Charmonium wave functions 

The spatial part of the cc pair wave function satisfying the Schrodinger equation 
(- — + V(R))& nlm (R)=E nl & nlm (R) (25) 
is represented in the form 

V(R) = * nl (R)-Y lm (6,<p) , (26) 

where R is 3-dimensional cc separation (not to be confused with the 2-dimen- 
sional argument r of the dipole cross section), \I/ n i(R) and Yi m (9,ip) are the 
radial and orbital parts of the wave function. The equation for radial ^(R) is 
solved with the help of the program [34]. The following four potentials V(R) 
have been used: 

• "COR": Cornell potential [35], 

"<"~5 + 5 (27) 

with k = 0.52, a = 2.34 GeV -1 and m c = 1.84 GeV. 

• "BT" : Potential suggested by Buchmiiller and Tye [36] with m c = 1.48 GeV. 
It has a similar structure as the Cornell potential: linear string potential at 
large separations and Coulomb shape at short distances with some refine- 
ments, however. 
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Fig. 4. The radial part of the wave function 9 n i{r) for the IS and 2S states calculated 
with four different potentials (see text). In this figure, r — R. 



"LOG" : Logarithmic potential [37] 

V{R) = -0.6635 GeV + (0.733 GcV) \og{R ■ 1 GeV) 

with m c — 1.5 GeV. 

"POW" : Power-law potential [38] 



V{R) = -8.064 GeV + (6.898 GcV) (R • 1 GeV) 



o.i 



(28) 



(29) 



with m c = 1.8 GeV. 

The results of calculations for the radial part \I/ n i(R) of the IS and 2S states 
are depicted in Fig. 4. For the ground state all the potentials provide a very 
similar behavior for R > 0.3 fm, while for small R the predictions are differ by 
up to 30%. The peculiar property of the 2S state wave function is the node at 
R w 0.4 fm which causes strong cancelations in the matrix elements Eq. (18) and 
as a result, a suppression of photoproduction of tp' relative to J/ip [33,39]. 

Note that the lowest Fock component |cc) in the infinite momentum frame is 
not related by simple Lorentz boost to the wave function of charmonium in the 
rest frame. This makes the problem of building the light-cone wave function for 
the lowest |cc) component difficult, no unambiguous solution is yet known. There 
are only recipes in the literature, a simple one widely used [40] , is the following. 
One applies a Fourier transformation from coordinate to momentum space to 
the known spatial part of the non-relativistic wave function (26), fy(R ) => \P(p), 
which can be written as a function of the effective mass of the cc, M 2 = 4(p 2 + 



;), expressed in terms of light-cone variables 



M 2 (a, PT ) 



p 2 T + m 2 c 
a(l — a) 



(30) 
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In order to change the integration variable pl to the light-cone variable a one 
relates them through M, namely pl = (a — l/2)M(p<r, a). In this way the cc 
wave function acquires a kinematical factor 

^ StmgP ' 55 **(«.!*) • < 31 > 

This procedure is used in [41] and the result is applied to calculation of 
the amplitudes (18). The result is discouraging, since the ip' to J/ip ratio of the 
photoproduction cross sections are far too low in comparison with data. However, 
the oversimplified dipole cross section a q q(r) oc r 2 has been used, and what is 
even more essential, the important ingredient of Lorentz transformations, the 
Mclosh spin rotation, has been left out. The spin transformation has also been 
left out in the recent publication [42] which repeats the calculations of [41] with 
a more realistic dipole cross section which levels off at large separations. This 
leads to suppression of the node-effect (less cancelation) and enhancement of if - ' 
photoproduction. Nevertheless, the calculated ip' to J/tp ratio is smaller than the 
data by a factor of two. 

The 2-spinors Xc and Xe describing c and c respectively in the infinite mo- 
mentum frame are known to be related by Mclosh rotation [43,40] to the spinors 
Xc and Xe in the rest frame: 

X c = R{u,Pt)Xc , 

X c = R(l-a,-pr)Xc , (32) 

where the matrix R(a,pT) has the form: 

s m c + aM -i[<j xn]p T . . 

K(a,pT) = = — . (33 

V 7 ^(m c + aM) 2 +p 2 T V ' 

Since the potentials we use in section 4.1 contain no spin-orbit term, the cc 
pair is in S'-wave. In this case spatial and spin dependences in the wave function 
factorize and we arrive at the following light cone wave function of the cc in the 
infinite momentum frame 



where 



*!T ,A) (a,Pr) = U^(a lPT ) ■ 4>^a,p T ) , (34) 



U^\a,p T ) = X f RHa,p T ) rr-e^ay R*(l - a, -p T ) a' 1 x§ (35) 



and Xe is defined in (21). 

Note that the wave function (34) is different from one used in [44-46] where 
it was assumed that the vertex ip — > cc has the structure ip^uj^u like the for 
the photon 7* — > cc. The rest frame wave function corresponding to such a 
vertex contains S wave and D wave. The weight of the latter is dictated by the 
structure of the vertex and cannot be justified by any reasonable nonrelativistic 
potential model for the cc interaction. 
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Fig. 5. Integrated cross section for elastic photoproduction -yp — » J/tpp with real 
photons (Q 2 — 0) as a function of the energy calculated with GBW and KST dipole 
cross sections and for four potentials to generate J/tp wave functions. Experimental 
data points from the HI [47], E401 [48], E516 [49] and ZEUS [50] experiments. 



Now we can determine the light-cone wave function in the mixed longitudinal 
momentum - transverse coordinate representation: 

,A) («. = ^ / d2 PT ^ PTr *ST ,P) (a, Pt) ■ (36) 
4.2 Comparison with data 

Having the light-cone wave function of charmonium, we are now in the position 
to calculate the cross section of charmonium photoproduction using Eq. (18). 
The results for J/tp are compared with the data in Fig. 5. Calculations are 
performed with GBW and KST parameterizations for the dipole cross section 
and for wave functions of the J/tp calculated from BT, LOG, COR and POW 
potentials. One observes 

• There arc no major differences between different parameterizations [28,29] 
of the dipole cross section. 

• The use of different potentials to generate the wave functions of the J/tp 
leads to two distinctly different behaviors. The potentials labeled BT and 
LOG (see sect. 4.1) describe the data very well, while the potentials COR 
and LOG underestimate them by a factor of two. The different behavior has 
been traced to the following origin: BT and LOG use m c ~ 1.5 GeV, but 
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BT 


LOG 


COR 


POW 


Q7] GBW 
KST 

r 2 


52.01 (37.77) 
49.96 (35.87) 
66.67 (47.00) 


50.78 (36.63) 
48.49 (34.57) 
64.07 (44.86) 


23.13 (17.07) 
21.05 (15.42) 
25.81 (18.71) 


24.94 (18.64) 
22.83 (16.92) 
28.23 (20.66) 


H GBW 
KST 

r 2 


0.147 (0.075) 
0.147 (0.068) 
0.101 (0.034) 


0.117 (0.060) 
0.118 (0.054) 
0.081 (0.027) 


0.168 (0.099) 
0.178 (0.099) 
0.144 (0.070) 


0.144 (0.085) 
0.152 (0.084) 
0.121 (0.058) 



Table 1. The photoproduction 7p — * J/ipp cross-section a(J/ip) in nb and the ratio 
TZ = a(ip')/a(J/tp) for the four different types of potentials (BT, LOG, COR, POW) 
and the three parameterizations (GBW, KST, r ) for the dipole cross section a(r,s) at 
y/s — 90 GeV. The values in parentheses correspond to the case when the spin rotation 
is neglected. See Ref. [1] for a comparison with data. 



COR and POW m c w 1.8 GeV. While the bound state wave functions of J/tp 
are little affected by this difference (see Fig. 4), the photon wave function 
Eq. (20) depends sensitively on m c via the argument Eq. (22) of the K 
function. 

4.3 Importance of spin effects for the ip' to J/ip ratio 

It turns out that the effects of spin rotation have a gross impact on the cross 
section of elastic photoproduction -yp^> J/tp(tp')p . To demonstrate these effects 
we present the results of our calculations at y/s = 90 GeV in Table 1. The 
upper half of the table shows the photoproduction cross sections for J/tp for 
different parameterizations of the dipole cross section (GBW, KST, "r 2 ") and 
potentials (BT, COR, LOG, POW). The numbers in parenthesis show what the 
cross section would be, if the spin rotation effects were neglected. We see that 
these effects add 30-40% to the J/tp photoproduction cross section. 

The spin rotation effects turn out to have a much more dramatic impact on 
tp' increasing the photoproduction cross section by a factor 2-3. This is visible 
in the lower half of the table which shows the ratio TZ = a(ip')/a(J/tp) of pho- 
toproduction cross sections, where the number in parenthesis correspond to no 
spin rotation effects included. This spin effects explain the large values of the 
ratio TZ observed experimentally. Our results for TZ are about twice as large as 
evaluated in [42] and even more than in [41]. 

4.4 Charmonium-nucleon total cross sections 

After the light-cone formalism has been checked with the data for virtual pho- 
toproduction we are in position to provide reliable predictions for charmonium- 
nucleon total cross sections. The corresponding expressions are given by Eq. (19)) 
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Fig. 6. Total J/ipp (thick curves) and ip' p (thin curves) cross sections with the GBW 
and KST parameterizations for the dipole cross section. 



(compare with [13]). The calculated J/ip- and ^'-nucleon total cross sections are 
plotted in Fig. 6 for for the GBW and KST forms of the dipole cross sections 
and all four types of the charmonium potentials. 

5 Nuclear effects in exclusive leptoproduction of 
charmonia 

Charmonium production on nuclei can be exclusive, j*A — ► iPX, where X = A 
(coherent) or X = A* (incoherent), and inclusive when X includes pions. We skip 
the latter which is discussed in [51] and concentrate here on exclusive processes. 
In this case the following phenomena are to be expected: color filtering, i.e. 
inelastic interactions of the cc pair on its way through the nucleus is expected 
to lead to a suppression of W production relative to Aa^p^^,. Since the dipole 
cross section a q q also depends on the gluon distribution in the target (p of A), 
nuclear shadowing of the gluon distribution is expected to reduce a qq in a nuclear 
reaction relative to the one on the proton. Production of a cc pair in a nucleus 
and its absorption are also determined by the values of the coherence length l c 
and the formation length If [23]. 

Explicit calculations have been performed in Ref. [33] in the approximation 
of a short coherence (or production) length, when one can treat the creation of 
the colorless cc pair as instantaneous, 



(37) 



16 B. Z. Kopeliovich and J. Raufeisen 



where v is the energy of the virtual photon in the rest frame of the nucleus. At 
the same time, the formation length may be long, comparable with the nuclear 
radius Ra, 

lf= M^MV^ RA - (38) 

In Ref. [33] the wave function formation is described by means of the light- 
cone Green function approach summing up all possible paths of the cc in the 
nucleus. The result has been unexpected. Contrary to naive expectation, based 
on the larger size of the ip' compared to J/ip, it has been found that ip' is not 
more strongly absorbed than the J/tp, but may even be enhanced by the nuclear 
medium. This is interpreted as an effect of filtering which is easy to understand 
in the limit of long coherence length, l c ^> Ra- Indeed, the production rate 
of ip' on a proton target is small due to strong cancelations in the projection 
of the produced cc wave packet onto the radial wave function of the ip' which 
has a node. After propagation through nuclear matter the transverse size of a 
cc wave packet is squeezed by absorption and the projection of the ip 1 wave 
function is enhanced [33,39] since the effect of the node is reduced (see another 
manifestation of the node in [52]). 

However, the quantitative predictions of [33] are not trustable since the cal- 
culations have been oversimplified and quite some progress has been made on 
the form of the dipole cross section a q q and the light cone wave functions for 
the charmonia. Therefore we take the problem up again and provide more real- 
istic calculations for nuclear effects in exclusive electroproduction of charmonia 
off nuclei relying on the successful parameter free calculations which have been 
performed recently in Ref. [1] for elastic virtual photoproduction of charmonia, 
7*p — > typ (see sect. 4). 

Whenever one deals with high-energy reactions on nuclei, one cannot avoid 
another problem of great importance: gluon shadowing. At small values of x, 
gluon clouds overlap in longitudinal direction and may fuse. As a result, the 
gluon density per one nucleon in a nucleus is expected to be reduced compared 
to a free proton. Parton shadowing, which leads to an additional nuclear sup- 
pression in various hard reactions (DIS, DY, heavy flavor, high-py hadrons, etc.) 
may be especially strong for exclusive vector meson production like charmonium 
production which needs at least two gluon exchange. Unfortunately, we have no 
experimental information for gluon shadowing in nuclei so far, and we have to 
rely on the available theoretical estimates, see e.g. Refs. [53,18,29,54]. 



5.1 Eikonal shadowing versus absorption for cc pairs in nuclei 

Exclusive charmonium production off nuclei, j*A — > \PX is called coherent, 
when the nucleus remains intact, i.e. X = A, or incoherent, when X is an 
excited nuclear state which contains nucleons and nuclear fragments but no 
other hadrons. The cross sections depend on the polarization e of the virtual 
photon (in all figures below we will imply e = 1), 

a-'* A (s, Q 2 ) = a^ A (s, Q 2 ) + e a^ A (s, Q 2 ) , (39) 
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where the indexes T, L correspond to transversely or longitudinally polarized 
photons, respectively. 

The cross section for exclusive production of charmonia off a nucleon target 
integrated over momentum transfer [13] is given by 



T.L 



(40) 



where \P(r, a) is the charmonium LC wave function which depends on the trans- 
verse cc separation r and on the relative sharing a of longitudinal momentum [1] . 
Both variables are involved in the integration in the matrix element Eq. (40). 
tf^r, a) is obtained by means of a Lorentz boost applied the solutions of the 
Schrodingcr equation. This procedure involves the Melosh spin rotation [40,43] 
which produces sizable effects. In addition, 7 ce : (r, a, Q 2 ) is the LC wave func- 
tion of the cc Fock component of the photon. It depends on the photon virtuality 
Q 2 . One can find the details in Ref. [1] including the effects of a nonperturbative 
qq interaction. 

The cross sections for coherent and incoherent production on nuclei will be 
derived under various conditions imposed by the coherence length Eq. (37). At 
high energies the coherence length Eq. (37) may substantially exceed the nuclear 
radius. In this case the transverse size of the cc wave packet is "frozen" by Lorentz 
time dilation, i.e. it does not fluctuate during propagation through the nucleus, 
and the expressions for the cross sections, incoherent (inc) or coherent (coh), 
are particularly simple [33], 



<cr>,o 2 ) = jd 2 bT A (b) 
*:! h LA (s, Q 2 )=jd 2 b 



<J q q{r,s) exp 



--a qq {r,s)T A {b) 



T.L 



1 — exp 



--a qq -(r,s)T A (b) 



T.L 



7c 



(41) 
(42) 



Here T A (b) = dz p A {b 1 z) is the nuclear thickness function given by the 
integral of the nuclear density along the trajectory at a given impact parameter 
b. 

The nuclear suppression ratio for incoherent electroproduction of J/ip and ip' 
is shown in Fig. 7 as a function of ^/i. We use the GBW [28] and KST [29] 
parameterizations for the dipole cross section and show the results by solid and 
dashed curves, respectively. Differences are at most 10 — 20%. Analyzing the 
results shown in Fig. 7, we observe that nuclear suppression of J/ip production 
becomes stronger with energy. This is an obvious consequence of the energy de- 
pendence of <Jqq(r, s), which rises with energy (see sect. 3). For ip' the suppression 
is rather similar to the J/ip case. In particular we do not see any considerable 
nuclear enhancement of ip' which has been found earlier [33,55], where the over- 
simplified form of the dipole cross section, a q q(r) oc r 2 and the oscillator form 
of the wave function had been used. Such a form of the cross section enhances 
the compensation between large and small distances in the wave function of tp' 
in the process -f*p — > tp'p. Therefore, the color filtering effect which emphasizes 
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Fig. 7. Ratios for J/ip and ip' incoherent production on carbon, copper and lead 
as function of yfs and at Q 2 = 0. The solid curves refer to the GBW parameterization 
of o q q and dashed one refer to the KST parameterization. 



the small distance part of the wave function leads to a strong enhancement of 
the ip' production rate. This is why using the more realistic r-dependence of 
<J q q(r) leveling off at large r leads to a weaker enhancement of the ip'. This effect 
becomes even more pronounced at higher energies since the dipole cross section 
saturates starting at a value r ~ r o{s) where fo(s) decreases with energy. This 
observation probably explains why the ip' is less enhanced at higher energies as 
one can see from Fig. 7. 

Note that the "frozen" approximation is valid only for l c 3> Ra and can be 
used only at y/s > 20 — 30 GeV. Therefore, the low-energy part of the curves 
depicted in Fig. 7 should be corrected for the effects related to the finiteness of 
l c . This is done in Rcf. [1]. 

One can change the effect of color filtering in nuclei in a controlled way by 
increasing the photon virtuality Q 2 thereby squeezing the transverse size of the 
cc fluctuation in the photon. For a narrower cc pair the cancelation which is 
caused by the node in the radial wave function of ip' should be less effective. 
One expects that the ip' to J/ip ratio on a proton target increases with Q 2 , 
as is observed both in experiment and calculation (Fig. 9 of [1]). A detailed 
investigation of the Q 2 dependence of nuclear effects is published in Ref . [3] . 

Cross sections for coherent production of charmonia on nuclei are calculated 
analogously using Eq. (42). The results for the energy dependence are depicted 
in Fig. 8. 



Heavy flavor production off protons and in a nuclear environment 



19 




0.0 



10 



100 



0.0 



10 



100 



/s [GeV] 



[GeV] 



Fig. 8. The ratios R c f 'ftp and R^, for coherent production on nuclei as a function of 
yfs. The meaning of the different lines is the same as in Fig. 7. 



It is not a surprise that the ratios exceed one. In the absence of cc attenuation 
the forward coherent production would be proportional to A 2 , while integrated 
over momentum transfer, the one depicted in Fig. 8, behaves as A 4 / 3 . This is a 
result of our definition that R^ h exceeds one. 

5.2 Gluon shadowing 

The gluon density in nuclei at small Bjorken x is expected to be suppressed 
compared to a free nucleon due to interferences. This phenomenon called gluon 
shadowing renormalizes the dipole cross section, 

cr q q(r, x) =*> a q q(r, x) R G (x, Q 2 ,b). (43) 

where the factor Rq(x, Q 2 , b) is the ratio of the gluon density at x and Q 2 in a 
nucleon of a nucleus to the gluon density in a free nucleon. No data are available 
so far which could provide direct information about gluon shadowing. Currently 
it can be evaluated only theoretically. In what follows we employ the technique 
developed in Ref. [29]. 

Note that the procedure Eq. (43) differs from the prescription in Ref. [45]. 
The latter is based on QCD factorization applied to a nuclear target and suggests 
to multiply by Rq(x, Q 2 , b) the whole nuclear cross section. This approximation 
should not be used for charmonium production which exposes according to above 
calculations a strong deviation from factorization. Besides, gluon shadowing is 
overestimated in Ref. [45] as is discussed in Ref. [29]. 
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The interpretation of the phenomenon of gluon shadowing depends very much 
on the reference frame. It looks like glue-glue fusion in the infinite momentum 
frame of the nucleus: although the nucleus is Lorentz contracted, the bound 
nucleons are still well separated since they contract too. However, the gluon 
clouds of the nucleons are contracted less since they have a smaller momentum 
fraction <~ x. Therefore, they do overlap and interact at small x, and gluons 
originating from different nucleons can fuse leading to a reduction of the gluon 
density. 

Although observables must be Lorentz invariant, the space-time interpreta- 
tion of shadowing looks very different in the rest frame of the nucleus. Here 
it comes as a result of eikonalization of higher Fock components of the incident 
particles. Indeed, the nuclear effect included by eikonalization into Eqs. (41)-(42) 
corresponds to the lowest cc Fock component of the photon. These expressions do 
not include any correction for gluon shadowing, but rather correspond to shad- 
owing of sea quarks in nuclei, analogous to what is measured in deep-inelastic 
scattering. Although the phenomenological dipole cross section a q q(x,Q 2 ) in- 
cludes all possible effects of gluon radiation, the eikonal expressions Eqs. (41)- 
(42) assume that none of the radiated gluons takes part in multiple interaction 
in the nucleus. The leading order correction corresponding to gluon shadowing 
comes from eikonalization of the next Fock component which contains the cc 
pair plus a gluon. One can trace on Feynman graphs that this is exactly the 
same mechanism of gluon shadowing as glue-glue fusion in a different reference 
frame. 

Note that Eqs. (41)-(42) assume that for the coherence length l c ^> Ra- 
Even if this condition is satisfied for a cc fluctuation, it can be broken for the 
ccG component which is heavier. Indeed, it was found in [58] that the coherence 
length for gluon shadowing as about an order of magnitude shorter than the 
one for shadowing of sea quarks. Therefore, one should not rely on the long 
coherence length approximation used in Eqs. (41)-(42), but take into account 
the finiteness of if . This can be done by using the light-cone Green function 
approach developed in [56,29]. 

The factor Rg{x, Q 2 , b) has the form, 

where a(j*N) is the part of the total -f*N cross section related to a cc fluctuation 
in the photon, 

l 

<t( 7 * N) = Jd 2 r J da |^ r ^ cg (r, a, Q 2 )\ 2 a qq {r,x) . (45) 
o 

Here | f r 7 *^ ce (r, a, Q 2 ) is the light-cone wave function of the cc pair with trans- 
verse separation r and relative sharing of the longitudinal momentum a and 
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1 — a (see details in sect. 2). The numerator Aa(-f*A) in (44) reads [29] 

d 2 a{ 1 *N -> ccGN) 



(46) 

<?T=0 



OO oo 

x J dz\ Jdz 2 0(z 2 -zi)pa(P, zi) p A {b, z 2 ) cxp [-z <?l (z 2 - zi)] . 



-oo — oo 



Here the invariant mass squared of the ccG system is given by, 

M 2 = ! ^ ± ^ - (47) 

i 1 

where the sum is taken over partons (ccG) having mass mj, transverse momen- 
tum ki and fraction on of the full momentum. The ccG system is produced 
diffractivcly as an intermediate state in a double interaction in the nucleus. 
Z\ and z 2 are the longitudinal coordinates of the nuclcons Ni and N 2 , re- 
spectively, participating in the diffractive transition 7* N\ — > ccG N\ and back 
ccG N 2 — ► 7* N 2 . The value of Ao is controlled by the longitudinal momentum 
transfer 

Q 2 + M 2 

qL = , (48) 

which is related to the gluonic coherence length = 1/gz,. 

The Green function G C c G (r 2 , P2, z 2 ; r\, p\Z\) describes the propagation and 
interaction of the ccG system in the nuclear medium between the points z\ and 
z 2 . Here, 7*1,2 and p\ 2 are the transverse separations between the c and c and 
between the cc pair and gluon at the point z\ and destination z 2 respectively. 
Then the Fourier transform of the diffractive cross section in Eq. (46), 



8tt / dMl 



d 2 a(Y'N -» XN) 



x "~ dM 2 x dq\ 



cos [q L (z 2 - z-t)] (49) 

q T =0 



can be represented in the form, 

i Re J d 2 r 2 d 2 p 2 d 2 r\d 2 p\ J da q d\n(a G ) (50) 

x F l-^ C c G ( r 2,P2,a q ,a G ) G ceG {r 2 ,p 2 ,z 2 ;r l7 p 1 ,z 1 ) F 7 *^ C c G {ri, pi, a g , a G ) ■ 

Assuming that the momentum fraction taken by the gluon is small, ag <C 1, 
and neglecting the cc separation r <C p we arrive at a factorized form of the 
three-body Green function, 

G cSG {r 2 ,p 2 ,z 2 - 1 r 1 ,p 1} z 1 ) ^> G cS {r 2 ,z 2 ;r 1 ,z 1 ) G GG (p 2 ,z 2 ;p 1 ,z 1 ) , (51) 



where G GG (p 2 , z 2 ; pi, z\) describes propagation of the GG dipolc (in fact the 
color-octet cc and gluon) in the nuclear medium. This Green function satisfies 
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the two dimensional Schrodingcr equation which includes the glue-glue nonper- 
turbative interaction via the light-cone potential V(p,z), as well as interaction 
with the nuclear medium. 



i -j—G GG {p 2 , z 2 ] pi, zx) = 

az2 



A(P2) + V(p 2 ,z 2 ) 



2va G (l - a G ) 



G GG {p2,z 2 ;pi,z 1 ) , 

(52) 
where 

21mV(p,z) = -a GG (p)p A (b,z) , (53) 
and the glue-glue dipole cross section is related to the qq one by the relation, 



°GG{r, x) = - a g g(r, x) . (54) 



Following [29] we assume that the real part of the potential has a form 

Re V(p, z) = - . (55) 

VP ' ' 2va G {l~a G ) v ' 

The parameter bo — 0.65 GeV was fixed by the data on diffractive gluon radiation 
(the triple-Pomeron contribution in terms of Regge approach) which is an essen- 
tial part of Gribov's inelastic shadowing [57]. The well known smallness of such 
a diffractive cross section explains why bo is so large, leading to a rather weak 
gluon shadowing. In other words, this strong interaction squeezes the glue-glue 
wave packet resulting in small nuclear attenuation due to color transparency. 

Fig. 9 shows the ratios of cross sections calculated with and without gluon 
shadowing for incoherent and coherent exclusive charmonium electroproduction. 
We see that the onset of gluon shadowing happens at a cm. energy of few tens 
GeV. This onset is controlled by the longitudinal nuclear formfactor 

oc 

FA{q ^ b) ^T^(b) J dz P^ z )e lqcZ (56) 

— oo 

where the longitudinal momentum transfer q^ = l/l^. For the onset of gluon 
shadowing Ra ^> 1 one can keep only the double scattering shadowing cor- 
rection, 

Sg « 1 - \ veff J d 2 bT 2 A (b) Fi( 9c G , b) , (57) 

where a e ff is the effective cross section which depends on the dynamics of in- 
teraction of the qqG fluctuation with a nuclcon. 

It was found in Ref. [58] that the coherence length for gluon shadowing is 
rather short, 

lc « TTT- , (58) 

lOimjv 

where x in our case should be an effective one, x = (Q 2 + M^)/2m N i>. The 
onset of shadowing according to Eqs. (56) and (57) should be expected at q 2 ~ 
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Fig. 9. Ratios Sg{s, Q 2 ) of cross sections calculated with and without gluon shadowing 
for incoherent and coherent charmonia production. We only plot ratios for J/ij) produc- 
tion, because ratios for if)' production are practically the same. All curves are calculated 
with the GBW parameterization of the dipole cross section a q q. 

3/(i?^) 2 corresponding to 

s G ~ 10m N Rf(Q 2 + M|)/V3 , (59) 

where (Rf) 2 is the mean square of the nuclear charge radius. This estimate is 
in a good agreement with Fig. 9. Remarkably, the onset of shadowing is delayed 
with rising nuclear radius and Q 2 . This follows directly from Eq. (57) and the 
fact that the formfactor is a steeper falling function of Ra for heavy than for 
light nuclei, provided that Ra ^> 1. 

6 Hadroproduction of heavy quarks 

We now turn to open heavy flavor production in pp collisions [4,5]. The color 
dipole formulation of this process was first introduced in Ref . [59] . In the target 
rest frame, in which the dipole approach is formulated, heavy quark production 
looks like pair creation in the target color field, Fig. 10. For a short time, a 
gluon G from the projectile hadron can develop a fluctuation which contains 
a heavy quark pair (QQ). Interaction with the color field of the target then 
may release these heavy quarks. Apparently, the mechanism depicted in Fig. 10 
corresponds to the gluon-gluon fusion mechanism of heavy quark production 
in the leading order (LO) parton model. This can be verified by explicit an 
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Fig. 10. The three lowest order graphs contributing to heavy quark production in the 
dipole approach. These graphs correspond to the gluon-gluon fusion mechanism of heavy 
quark production in the parton model. 

calculation [5]. The dipole formulation is therefore applicable only at low X2, 
where the gluon density of the target is much larger than all quark densities 1 . 
The kincmatical range where the dipole approach is valid can of course only 
be determined a posteriori. This is similar to determining the minimal value of 
Q 2 for which perturbative QCD still works. Note that while the mechanism for 
hadroproduction of heavy quark boundstatcs is still subject to active theoretical 
and experimental investigation, the mechanism for open heavy quark production 
is well established by now [60-62]. 

We shall now express the process depicted in Fig. 10 in terms of the cross 
section a q q{r) for scattering a color neutral gg-pair with transverse size r off a 
nucleon. The QQ pair can be produced in three different color and spin states. 
These states are orthogonal and do not interfere in the cross section. They in- 
clude: 

1. The color-singlet C-even QQ state. The corresponding amplitude is odd (O) 
relative to simultaneous permutation of spatial and spin variables of the QQ 
and has the form, 

8 1 

A!£ a (K, k T , a) = J2 g ^ % Of (k, kr, a) . (60) 

e=l 

Here k and kr are the relative and total transverse momenta of the QQ pair 
respectively; fj,,fl are spin indexes, a and i, j are color indexes of the gluon 
and produced quarks, respectively. We will classify such a state as 1~, which 
means a color singlet with odd parity relative to index permutation. Note 
the 1 + cannot be produced in the reaction shown in Fig. 10 . 

2. Color-octet QQ state with the production amplitude also antisymmetric rel- 
ative simultaneous permutation of spatial and spin variables of the QQ (8~), 

8 1 

Btf a {K, k T , «) = E 2 daea Tg{lj) feT ' a) ■ (61) 

e,g=l 

Here \ g = r g /2 are the Gell-Mann matrices. 

1 We use standard kinematical variables, X2 = %Pqq ■ Pi/s and x\ = 2Pqq ■ Pz/s, 
where Pi (P2) is the four-momentum of the projectile (target) hadron, and Pqq is 
the four-momentum of the heavy quark pair. In addition, Mqq is the invariant mass 
of the pair, and s is the hadronic center of mass energy squared. 
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3. Color-octet QQ with the amplitude symmetric relative permutation of quark 
variables (8 + ), 

8 

Cg a (K, k T , a)=Y.\ fae9 T9{l]) E ^ {K ' fer ' a) ■ (62) 

e,ff=l 

The two amplitudes in Eq. (60) and (61) contain the common factor 

0^(K,k T ,a) = J d 2 rd 2 se iKr -' lkTa ^(r) fr e \s-ar)-^ e \s+ar)^ , (63) 

which is odd (O) under permutation of the non-color variable of the quarks. 
Correspondingly, the even (E) factor in the amplitude Eq. (62) reads, 

Ejp(K,k T ,a) = 



1 



d 2 rd 2 sc iK - r+ikT - s ^ Q (r) ^ e \s-ar)+ 1 (e \s + ar)-2j^(s) ,(64) 



Here s and r is the position of the center of gravity and the relative transverse 
separation of the QQ pair, respectively. It becomes evident from Eqs. (63) and 
(64), that the production amplitude for the QQ-pair depends on the difference 
between the interaction amplitudes represented by the three graphs in Fig. 10. 
For example, the two terms in the square bracket in Eq. (63) correspond to the 
two first graphs in Fig. 10. If the Q and the Q would scatter at the same impact 
parameter, the production amplitude would vanish and nothing is produced. We 
stress that the interaction amplitudes represented by each of the three graphs in 
Fig. 10 is infrared divergent. This divergence, however, cancels in the production 
amplitude of the heavy quark pair, and therefore one can express the cross section 
for heavy flavor production in terms of color neutral quantities, such as the dipole 
cross section a q q. 

The LC wave function ^^(r) of the QQ component of the incident gluon 
in Eqs. (63)-(64) reads, 



*QQ^ ~fffK (m Q r) , (65) 

where the vertex operator has the form, 

f = m Q er • e + i(l - 2a) (er • n)(e • V) + (n x e) • V , (66) 

where V = d/dr; a is the fraction of the gluon light-cone momentum carried 
by the quark Q and a is the analogous quantity for the antiquark Q; e is the 
polarization vector of the gluon and tuq is the heavy quark mass. 

The profile function ^ e \s) in Eqs. (63) -(64) is related by Fourier trans- 
formation to the amplitude F^(kx,{X}), of absorption of a real gluon by a 
nucleon, GN — > X, which also can be treated as an "elastic" (color-exchange) 
gluon- nucleon scattering with momentum transfer kr, 

^•'-^/^^^-^•w*- (67) 
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where the upper index (e) shows the color polarization of the gluon, and the 
variables {X} characterize the final state X including the color of the scattered 
gluon. 

It is important for further consideration to relate the profile function (67) to 
the unintegrated gluon density F{kT, x) and to the dipolc cross section <7 qq (r, x) 
(cf. sect. 2), 



r 8 i 

/ d 2 bd{X} h {e) (s + r)-"f ie) (s) 

J e=l 

T°"J 



d 2 k T 



(l-c ife —) F(k T ,x 2 ) = a qq (r,x 2 ) . 



(68) 



Let us consider the production cross sections of a QQ pair in each of three 
states listed above, Eqs. (60)-(62). The cross section of a color-singlet QQ pair, 
averaged over polarization and colors of the incident gluon reads, 



a 



(i) _ 



(27T) 



71-14 



da / d Kd kr 



A% a ( K ,k T ,a) 



(69) 



Using Eqs. (63), (65) and (68) this relation can be modified as, 

l 



=J2jdaj d 2 ra 1 (r,a) &^(r,a) 



where 



1 



a. 



ai(r,a) = -a qq (r,x 2 ) ; 



m Q K o( m Q r ) + (« 2 + a2 ) m Q K i( m Q r ) 



(70) 

(71) 
(72) 



One finds in a similar way that the cross sections of a color-octet QQ pair 
production either in 8~ (Odd) or 8 + (Even) states has the form, 



7 (8) 
T 0(E) 



1 

]T ] j 'da J d 2 ra^ {E) (r,a)\<P^(r,a) 



where 



<T { o\r,a,x 2 ) = — cT q g(r,x 2 ) ; 

a^\r,a,x 2 ) = ^ 2a qq {ar,x 2 ) + 2a qq (ar,x 2 ) - a qq (r,x 2 ) 



(73) 

(74) 
(75) 



After summation over all three color states in which the QQ pair in Fig. 10 
can be produced, one obtains for the partonic cross section [4], 

a(GN - {QQ}X) = j\a J d 2 r \>P G ^ QQ (a,r)\ 2 <r qqG (a,r), (76) 
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where a qq Q is the cross section for scattering a color neutral quark-antiquark- 
gluon system on a nucleon [4], 

9 l 

<r q qa{a, r) = - [o qq {ar) + a qq (ar)} - -a qq (r). (77) 

In order to simplify the notation, we do not explicitly write out the x 2 depen- 
dence of the dipole cross section. 

The light-cone (LC) wavefunctions for the transition G — > QQ can be calcu- 
lated perturbatively and a very similar to the ones in leptoproduction, Eq. (34), 

'G^QQ{<*,n)*Z:^QQ(<*,r2) = ^p^|m|Ko(mQri)Ko(m Q r 2 ) (78) 

+ [a 2 + a 2 ] mQ V ^ ^ 2 Ki(mQri)Ki(mqr 2 )| , 

where a s (/ijj) is the strong coupling constant, which is probed at a renormaliza- 
tion scale hr ~ tuq. 

Eq. (76) is a special case of the general rule that at high energy, the cross 
section for the reaction a + N — > {b, c, . . .}X can be expressed as convolution of 
the LC wavefunction for the transition a — > {b, c, . . .} and the cross section for 
scattering the color neutral {anti— a, b,c. . .}-system on the target nucleon N. 

Note that although the dipole cross section is flavor independent, the integral 
Eq. (76) is not. Since the Bcssel functions K^o decay exponentially for large 
arguments, the largest values of r which can contribute to the integral are of 
order ~ \ jm,Q. We point out, that as a consequence of color transparency [13,22], 
the dipole cross section vanishes oc r 2 for small r. Therefore, the QQ production 
cross section behaves roughly like oc I/nig (modulo logs and saturation effects). 

We can estimate the relative yield of the 1~, 8~ and 8 + states we can rely 
upon the approximation <r q q(r) oc r 2 which is rather accurate in the case of a 
QQ pair, since its separation r ~ I/tuq is small. We then derive, 

^ ■ °f ■ 4 8) = 1 '-I ■ ^- (79) 



Thus, about 20% of the produced QQ pairs are in a color-singlet state, the rest 
are color-octets. 

In order to calculate the cross section for heavy quark pair production in pp 
collisions, Eq. (76) has to be weighted with the projectile gluon density, 

da( PP ^{QQ}X) = XiG{xi ^ p) a{GN ^ {QQm m 

where y = ^ln(xi/x 2 ) is the rapidity of the pair and fip <~ rriQ. In analogy to 
the parton model, we call fip the factorization scale. Uncertainties arising from 
the choice of this scale will be investigated in section 6.1. Integrating over all 
kincmatically allowed rapidities yields 



a tot (pp^{QQ}X) = 2 / dy x\G {x\, n F ) a(GN — > {QQ}X). 

Jo 



(81) 
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A word of caution is in order, regarding the limits of the a-integration in 
Eq. (76). Since the invariant mass of the QQ-pair is given by 

k 2 , + m 2 n 

M QQ = - ( 82 ) 

the cndpoints of the a-integration include configurations corresponding to ar- 
bitrarily large invariant masses, eventually exceeding the total available cm. 
energy. However, since r and k± (the single quark transverse momentum) are 
conjugate variables, the pair mass is not defined in the mixed representation, 
nor are the integration limits for a. Fortunately, this problem is present only at 
the very edge of the phase space and therefore numerically negligible. 



6.1 Numerical results for hadroproduction of heavy quarks 

Still the questions remain, how well does the dipolc approach describe experi- 
mental data. Since there are not many data for the total cross section, we shall 
also compare predictions from the dipole approach to calculations in the NLO 
parton model [60-62] 2 For a q q, we use an improved version of the saturation 
model presented in Ref. [28], which now also includes DGLAP evolution [63]. 
This improvement has no effect on open charm, but is important for bottom 
production. 

In the dipolc approach, we use the one loop running coupling constant, 

47T 

a 8 (m) = — 7 - 2 r (83) 

at a renormalization scale /ir ~ itiq , and the number of light flavors is chosen 
to be Nf = 3 for open charm and Nf = 4 for open bottom production. Further- 
more, we use the GRV98LO [64] gluon distribution to model the gluon density 
in the projectile. We use a leading order parton distribution function (PDF), 
because of its probabilistic interpretation. Note that one could attempt to calcu- 
late the projectile gluon distribution from the dipole cross section. However, the 
projectile distribution functions are needed mostly at large momentum fraction 
xi, where the dipole cross section is not constrained by data. 

Our results for the total charm pair cross section in proton-proton (pp) colli- 
sions is shown in Fig. 11 as function of center of mass energy. The left panel shows 
the uncertainties of both approaches by varying quark mass m c and renormal- 
ization scale hr in the intervals 1.2 GeV < m c < 1.8 GeV and m c < ^r < 2m c , 
respectively. The factorization scale is kept fixed at fip = 2m c , because in our 
opinion, the charm quark mass is too low for DGLAP evolution. A large fraction 
of the resulting uncertainty originates from different possible choices of the charm 
quark mass, since the total cross section behaves approximately like a to t °c ™q 2 - 

2 A FORTRAN program for the NLO parton model calculation is available at 
http://n. home, cern.ch/n/nason/www/hvqlib. html. 
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Fig. 11. Results for the total open charm pair cross section as function of cm. energy. 
Varying free parameters in dipole approach (solid lines) and in the parton model (dashed 
lines) gives rise to the uncertainties shown on the left. In the figure on the right, 
parameters in both models have been adjusted so that experimental data [65,66] are 
described. 



Note that the mean value of x 2 increases with decreasing energy. At y/s — 
130 GeV one has x 2 ~ 0.01. For lower energies, our calculation is an extrapolation 
of the saturation model. For the highest fixed target energies of \fs w 40 GeV, 
values of x 2 ~ 0.1 become important. Unlike in the Drcll-Yan case, which was 
studied in [6] , the dipole approach to heavy quark production does not show any 
unphysical behavior when extrapolated to larger x 2 . One reason for this is that 
the new saturation model [63] assumes a realistic behavior of the gluon density 
at large x 2 . In addition, even at energies as low as \fs = 15 GeV, the gluon-gluon 
fusion process is the dominant contribution to the cross section. 

Because of the wide uncertainty bands, one can adjust m c and llr in both 
approaches so that experimental data are reproduced. Then, dipole approach 
and NLO parton model yield almost identical results. However, the predictive 
power of the theory is rather small. In Fig. 11 (right), we used m c = 1.2 GeV 
and lxr — 1.5m c for the NLO parton model calculation and m c = 1.4 GeV, 
IXr = ra c in the dipole approach. The data points tend to lie at the upper edge 
of the uncertainty bands, so that rather small values of m c are needed to describe 
them. 

There are remaining uncertainties which are not shown in Fig. 11 (right), 
because different combinations of m c and llr can also yield a good description 
of the data. In addition, different PDFs will lead to different values of the cross 
section at high energies, since the heavy quark cross section is very sensitive 
to the low-x gluon distribution. In [67], it was found that an uncertainty of a 
factor of <~ 2.3 remains at y/s = 14 TcV (in the NLO parton model), even after 
all free parameters had been fixed to describe total cross section data at lower 
energies. It is interesting to see that 20 - 30% of the total pp cross section at 
LHC (y/s = 14 TeV) goes into open charm 3 . 

3 The Donnachie-Landshoff parameterization of the total pp cross section [68] predicts 
<Ct = 14 TeV) = 100 mb. 
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Fig. 12. Uncertainties of open bb pair production calculated in the dipole approach 
(solid) and in the NLO parton model (dashed). The dipole approach seems to provide 
a better description of the data, even though HERA-B energy is too low for the dipole 
approach. 

Next, we calculate the total 66-pair cross section as function of center of mass 
energy, see Fig. 12. In order to quantify the theoretical uncertainties, we vary the 
free parameters over the ranges 4.5 GeV < nib < 5 GeV and nib < /j,r, hf < 2m& 
Because of the large &-quark mass, uncertainties are much smaller than for open 
charm production. One can see that the dipole approach tends to predict higher 
values than the NLO parton model, even though the energy dependence expected 
in both approaches is very similar. In fact, the results calculated in the dipole 
approach with nib = 5 GeV agree almost exactly with the NLO parton model 
calculation with nib = 4.5 GeV. For all other values of m&, the uncertainty bands 
of the two approaches do not overlap, in contrast to the case for open charm 
production. 

Three measurements of open bb production are published in the literature 
[69-71]. The two values of the open bottom cross section measured at Fcrmilab 
[69,70] at cm. energy yfs = 38.8 GeV differ by almost three standard deviations. 
The HERA-B measurement at slightly larger cm. energy yfs = 41.6 GeV [71] is 
consistent with the E771 [70] value. These two points seem to be better described 
by the dipole approach, though the NLO parton model (with nib = 4.5 GeV) still 
touches the HERA-B error bar. Note that also a different set of PDFs would not 
significantly pull up the parton model curve [67] , as a lower value of the 6-quark 
mass would do. With a resummation of terms from higher order corrections [72], 
however, the parton model can reproduce each of the three measurements within 
theoretical uncertainties, see Ref. [71]. On the other hand, typical values of x-i 
which are important for bb production at HERA-B energy are of order x^ ~ 0.2, 
while the parameterization [63] of the dipole cross section is constrained only by 
DIS data with x B j < 0.01. 
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While it is an advantage of the dipole formulation to provide very simple 
formulas that allow one to absorb much of the higher order corrections into a 
phenomenological parameterization of a q q(x2,r), one cannot clarify the origin 
of the discrepancy in normalizations without a systematic calculation of higher 
orders in this approach. 

7 Nuclear effects in hadroproduction of open charm 

It is still unclear whether available data from fixed target experiments demon- 
strate any nuclear effects for open charm production [73-75] . Naively one might 
expect no effects at all, since a heavy quark should escape the nucleus without 
attenuation or reduction of its momentum. In fact, this is not correct even at 
low energies as is explained below. Moreover, at high energies one cannot specify 
any more initial or final state interactions. The process of heavy flavor produc- 
tion takes a time interval longer than the nuclear size, and the heavy quarks 
are produced coherently by many nucleons which compete with each other. As 
a result the cross section is reduced, and this phenomenon is called shadowing. 

In terms of parton model the same effect is interpreted in the infinite mo- 
mentum frame of the nucleus as reduction of the nuclear parton density due to 
overlap and fusion of partons at small Bjorken x. The kinematic condition for 
overlap is the same as for coherence in the nuclear rest frame. Thus, heavy quark 
via gluon fusion can be shadowed in the leading twist, if the gluon density in 
nuclei is reduced due to gluon shadowing. 

There are well known examples of shadowing observed in hard reactions, 
like deep-inelastic scattering (DIS) [76] and the Drell-Yan process (DY) [77] 
demonstrating a sizable reduction of the density of light sea quarks in nuclei. 
Shadowing is expected also for gluons, although there is still no experimental 
evidence for that. 

Shadowing for heavy quarks is a higher twist effect, and although its mag- 
nitude is unknown within the standard parton model approach, usually it is 
neglected for charm and beauty production. However, this correction is propor- 
tional to the gluon density in the proton and steeply rises with energy. Unavoid- 
ably, such a correction should become large at high energies. In some instances, 
like for charmonium production, this higher twist effect gains a large numerical 
factor and leads to a rather strong suppression even at energies of fixed target 
experiments (see below). 

On the other hand, gluon shadowing which is a leading twist effect, is ex- 
pected to be the main source of nuclear suppression for heavy flavor production 
at high energies. This is why this process is usually considered as a sensitive 
probe for the gluon density in hadrons and nuclei. If one neglects terms sup- 
pressed by a power of 1/toq, the cross section of heavy QQ production in pA 
collision is suppressed by the gluon shadowing factor compared to the sum 
of A nucleon cross sections, 

a^(x 1 ,x 2 ) = Ri(x u x 2 )Aa^(x 1 ,x 2 ) . (84) 
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Here 

R%(x u x 2 ) = jj d 2 bR%(x u x 2 ,b)T A (b) , (85) 

where R A (xi,x 2 ,b) is the (dimensional) gluon shadowing factor at impact pa- 
rameter 6; = J_ ryo dz pA(b, z) is the nuclear thickness function, and Xi, x 2 
are the Bjorken variables of the gluons participating in QQ production from the 
colliding proton and nucleus. 

The parton model cannot predict shadowing, but only its evolution at high 
Q 2 , while the main contribution originates from the soft part of the interaction. 
The usual approach is to fit data at different values of x and Q 2 employing 
the DGLAP evolution and fitting the distributions of different parton species 
parametrized at some intermediate scale [78,79]. However, the present accuracy 
of data for DIS on nuclei do not allow to fix the magnitude of gluon shadowing, 
which is found to be compatible with zero 4 . Nevertheless, the data exclude some 
models with too strong gluon shadowing [80]. 

Another problem faced by the parton model is the impossibility to predict 
gluon shadowing effect in nucleus- nucleus collisions even if the shadowing factor 
Eq. (84) in each of the two nuclei was known. Indeed, the cross section of QQ 
production in collision of nuclei A and B at impact parameter b reads, 

daf B {xuX 2 ) = R G AB{xi ^ b)ABa QQ N{xiM (86) 

where 

R%( Xl ,x 2 ,b) = -^ J d 2 sR ( l{x u s)T A {s) R%{x 2 ,b- s)T B {b- s) . (87) 

In order to calculate the nuclear suppression factor Eq. (87) one needs to know 
the impact parameter dependence of gluon shadowing, R^(xi,b), while only 
integrated nuclear shadowing Eq. (85) can be extracted from lepton- or hadron- 
nucleus data 5 . Note that the parton model prediction of shadowing effects for 
minimum bias events integrated over b suffers the same problem. Apparently, 
QCD factorization cannot be applied to heavy ion collisions even at large scales. 
The same is true for quark shadowing expected for Drell-Yan process in heavy 
ion collisions [15,54,81]. 

Nuclear shadowing can be predicted within the light-cone (LC) dipole ap- 
proach which describes it via simple cikonalization of the dipole cross section. 
It was pointed out in Ref. [13] that quark configurations (dipoles) with fixed 
transverse separations are the eigenstates of interaction in QCD, therefore eikon- 
alization is an exact procedure. In this way one effectively sums up the Gribov's 
inelastic corrections to all orders [13]. 

4 Gluon shadowing was guessed in [78] to be the same as for F2(x, Q 2 ) at the semi-hard 
scale. 

5 One can get information on the impact parameter of particle-nucleus collision mea- 
suring multiplicity of produced particles or low energy protons (so called grey tracks) . 
However, this is still a challenge for experiment. 
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The advantage of this formalism is that it does not need any i-T-factor. Indeed, 
it was demonstrated recently in Ref. [6] that the simple dipole formalism for 
Drcll-Yan process [15,82,83] precisely reproduces the results of very complicated 
next-to-leading calculations at small x. The LC dipole approach also allows to 
keep under control deviations from QCD factorization. In particular, we found 
a substantial process-dependence of gluon shadowing due to the existence of a 
semi-hard scale imposed by the strong nonperturbative interaction of light-cone 
gluons [29] . For instance gluon shadowing for charmonium production off nuclei 
was found in Ref. [2] to be much stronger than in deep-inelastic scattering [29] . 

The LC dipole approach also provides effective tools for calculation of trans- 
verse momentum distribution of heavy quarks, like it was done for radiated 
gluons in Ref. [83,84], or Drcll-Yan pairs in Ref. [54]. Nuclear broadening of 
transverse momenta of the heavy quarks also is an effective way to access the 
nuclear modification of the transverse momentum distribution of gluons, i.e. the 
so called phenomenon of color glass condensate or gluon saturation [85,86]. We 
consider only integrated quantities here. 

In what follows we find sizable deviations from QCD factorization for heavy 
quark production off nuclei. First of all, for open charm production shadowing 
related to propagation of a cc pair through a nucleus is not negligible, especially 
at the high energies of RHIC and LHC, in spite of smallness of cc dipoles. Further, 
higher Fock components containing gluons lead to gluon shadowing which also 
deviates from factorization and depends on quantum numbers of the produced 
heavy pair cc. 



7.1 Higher twist shadowing for cc production 

An important advantage of the LC dipole approach is the simplicity of calcula- 
tions of nuclear effects. Since partonic dipoles are the eigenstates of interaction 
one can simply eikonalize the cross section on a nucleon target [13] provided that 
the dipole size is "frozen" by Lorentz time dilation. Therefore, the cross section 
of a cc pair production off a nucleus has the form [59,4], 



a(GA -» ccX) - 2 ^ ) j d 2 b j d 2 r J da ^(r,a) 



x < i - exp 



~2 VqqG{r,a,x 2 )T A (b) 



} 



(88) 



where cr q qG(r, a, x 2 ) is the cross section of interaction of a ccG three particle 
state with a nucleon, see sect. 6. 

Apparently, this expression leads to shadowing correction which is a higher 
twist effect and vanishes as 1/m 2 .. Indeed, it was found in [59] that in the 
kinematic range of fixed target experiments at the Tevatron, Fermilab, x 2 ~ 
10~ 2 , x F <~ 0.5, the shadowing effects are rather weak even for heavy nuclei, 



1 - R A < 0.05 , 



(89) 
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where Ra is defined in (84). 

On the other hand, a substantial shadowing effect, several times stronger 
than in Eq. (89) was found in Ref. [2] for charmonium production (see below), 
although it is also a higher twist effect. In the case of open charm production 
there are additional cancelations which grossly diminish shadowing. The small- 
ness of the effect maybe considered as a justification for the parton model pre- 
scription to neglect this correction as a higher twist effect. However, the dipole 
cross section <7 qq -{r, x-i) steeply rises with \fxi especially at small r and and the 
shadowing corrections increase, reaching values of about 10% at X2 — 10 -3 , and 
about 30% at x 2 = 10~ 5 . 

7.2 Process dependent gluon shadowing 

The phcnomcnological dipole cross section which enters the exponent in Eq. (88) 
is fitted to DIS data. Therefore it includes effects of gluon radiation which are 
in fact the source of rising energy (1/x) dependence of the a qq {r,x). However, a 
simple cikonalization in Eq. (88) corresponds to the Bethe-Heitler approximation 
assuming that the whole spectrum of gluons is radiated in each interaction inde- 
pendently of other rescatterings. This is why the higher order terms in expansion 
of (88) contain powers of the dipole cross section. However, gluons radiated due 
to interaction with different bound nuclcons can interfere leading to damping of 
gluon radiation similar to the Landau-Pomeranchuk [87] effect in QED. There- 
fore, the cikonal expression Eq. (88) needs corrections which are known as gluon 
shadowing. 

Nuclear shadowing of gluons is a leading twist effect since the cloud of mass- 
less gluons has a larger size than the source which is a small size barcc pair. Gluon 
shadowing is treated by the parton model in the infinite momentum frame of 
the nucleus as a result of glue-glue fusion. On the other hand, in the nuclear rest 
frame the same phenomenon is expressed in terms of the Glauber like shadowing 
for the process of gluon radiation [88]. In impact parameter representation one 
can easily sum up all the multiple scattering corrections which have the sim- 
ple eikonal form [13]. Besides, one can employ the well developed color dipole 
phenomenology with parameters fixed by data from DIS. Gluon shadowing was 
calculated employing the light-cone dipole approach for DIS [29] and production 
of charmonia [2] , and a substantial deviation from QCD factorization was found. 
Here we calculate gluon shadowing for cc pair production. 

First of all, one should develop a dipole approach for gluon radiation accom- 
panying production of a cc pair in gluon-nucleon collision. Then nuclear effects 
can be easily calculated via simple eikonalization. This is done in Ref. [4]. 

According to the general prescription [15] the dipole cross section which 
enters the factorized formula for the process of parton a-nucleon collision leading 
to multiparton production, aN^>b + c+... + dX, is the cross section for the 
colorless multiparton ensemble \abc...d). The same multiparton dipole cross 
section is responsible for nuclear shadowing. Indeed, in the case of the process 
G N — > cc X it was the cross section cr qq G , Eq. (77) , which correspond to a state 
|ccG) interacting with a nuclcon. 
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Fig. 13. Ratio of gluon densities Ro(Au/p) = Gau(x2)/W5 G p (x2) for color octet- 
octet and singlet-octet states (cc) — G (dashed curves). The averaged gluon shadowing 
is depicted by the solid curve. 



Correspondingly, in the case of additional gluon production, G — > ccG, it 
is a 4-parton, \ccGG), cross section 04(r, p, a\, ct2, 0:3). Here r and p are the 
transverse cc separation and the distance between the cc center of gravity and 
the final gluon, respectively. Correspondingly, ot\ — a c , a 2 — a s , and a 3 = ag. 
Treating the charm quark mass as a large scale, one can neglect r <C p, then 
the complicated expression for er 4 becomes rather simple. One can find details 
in Ref. [4]. 

One can treat partons as free only if their transverse momenta are sufficiently 
large, otherwise the nonperturbative interaction between partons may generate 
power corrections [29] . Apparently, the softer the process is, the more important 
are these corrections. In particular, diffraction and nuclear shadowing are very 
sensitive to these effects. Indeed, the cross section of diffractive dissociation 
to large masses (so called triple-Pomeron contribution) is proportional to the 
fourth power of the size of the partonic fluctuation. Therefore, the attractive 
nonperturbative interaction between the partons squeezes the fluctuation and 
can substantially reduce the diffractive cross section. Smallness of the transverse 
separation in the quark-gluon fluctuation is the only known explanation for the 
observed suppression of the diffractive cross section, which is also known as the 
problem of smallness of the triple-Pomeron coupling. While no data sensitive to 
gluon shadowing are available yet, a vast amount of high accuracy diffraction 
data can be used to fix the parameters of the nonperturbative interaction. 
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It turns out [4] that the color interaction between the gluon and the cc pair 
depends on color states of the latter. If the cc pair is in one of the two color 
octet states, the nonperturbative interaction between the pair and the gluon is 
strong, and the \qq~G) system cannot become larger than a typical constituent 
quark radius ~ 0.3 fm. For these small configurations, shadowing is rather small, 
see Fig. 13. If, on the other hand, the cc pair is in a color singlet state, the color 
charges of the c and the c screen each other, so that the pair cannot interact 
strongly with the radiated gluon, i.e. the value of 6o (see sect. 5.2) is much 
smaller than 0.65 GeV. The transverse size of these configurations is limited only 
by confinement, hence they can become as large as a typical hadron. Therefore, 
gluon shadowing is much stronger in the color singlet channel [2] . 

7.3 Numerical results 

To observe the shadowing effects in open charm production, one must access 
the kinematic region of sufficiently small xi < 0.1. With fixed targets it can 
be achieved at highest energies at Fermilab and in the experiment HERA-B at 
DESY. We apply the results of the previous section for gluon shadowing to cc 
pair production in proton-nucleus collisions. We assume that the cc is produced 
with Feynman xp corresponding to X2 — (—Xf + \J x p + 4M^ E / s)/2, where we 
fix M C c = 4 GeV. The contribution of gluon shadowing to nuclear effects in 
proton-tungsten collision at pi a b = 900 GeV is depicted by the dashed curve in 
Fig. 14. 

The higher twist shadowing correction, which corresponds to the cikonalizcd 
dipole cross section a q qG in Eq. (88), is also a sizable effect and should be added. 
It is diminished, however, due to the strong gluon shadowing which also reduces 
the amount of gluons available for multiple interactions compared to the eikonal 
approximation Eq. (88). We take this reduction into account multiplying a q qc 
in Eq. (88) by Rg(x2, M 5c ). This procedure is justified at small transverse sepa- 
rations, since a(r,x) = (it 2 /3) a s / r 2 G(x,Q 2 ~ 1/r 2 ) [45]. For large separations 
see discussion in Ref. [2] . The summed shadowing suppression of cc production 
is depicted in Fig. 14 by the solid curve. 

Besides shadowing, other nuclear effect arc possible. The EMC effect, sup- 
pression of the nuclear structure function F^(x,Q 2 ) at large x, as well as the 
enhancement at x <~ 0.1 should also lead to similar modifications in the gluon dis- 
tribution function G A (x, Q 2 ). These effects are different from shadowing which 
is a result of coherence. A plausible explanation relates them with medium ef- 
fects, like swelling of bound nucleons [89]. To demonstrate a possible size of the 
medium effects on gluon distribution we parametrize and apply the effect of 
gluon enhancement and suppression at large x suggested in Ref. [78]. Although 
it is based on ad hoc gluon shadowing and underestimated shadowing for valence 
quarks (see discussion in Ref. [54]), it demonstrates the scale of possible effects 
missed in our analysis. 

There are still other effects missed in our calculations. At this energy, the 
effect of energy loss due to initial state interactions [90] causes additional nuclear 
suppression at large xp (compare with Ref. [2]). Another correction is related to 
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Fig. 14. Nuclear effects for open charm production in p W collisions at 900 GeV 

beam energy. The contribution of gluon shadowing is shown by dashed curve. The solid 
curve represents the full shadowing effect including the higher twist contribution given 
by Eq. (88). Possible medium effects including antishadowing and EMC-suppression 
for gluons [78] are also added and the result is represented by the dotted curve. 



the observation that detection of a charm hadron at large \xf\ does not insure 
that it originates from a charm quark produced perturbatively with the same 
xf- Lacking gluons with x\^ — > 1 one can produce a fast charm hadron via a 
fast projectile (usually valence) quark which picks up a charm quark created at 
smaller |:ef|- This is actually the mechanism responsible for the observed D/D 
asymmetry. It provides a rapidity shift between the parent charm quark and the 
detected hadron. Therefore, it may reduce shadowing effects at largest \xp\. We 
leave this problem open for further study. 

To predict shadowing effects in heavy ion collisions we employ QCD factor- 
ization, which we apply only for a given impact parameter. For minimal bias 
events 



where y = ln(xi/x2)/2 is the rapidity of the cc pair. Our predictions for RHIC 
(y/s = 200 GeV) and LHC (y/s = 5500 GeV) are depicted in Fig. 15 separately 
for net gluon shadowing (dashed curves) and full effect including higher twist 
quark shadowing (solid curves). Although shadowing of charmed quarks is a 
higher twist effect, its contribution is about 10% at RHIC and rises with energy. 

One might be surprised by the substantial magnitude of shadowing expected 
at the energy of RHIC. Indeed, the value of x\$ ~ 0.02 at mid-rapidity is rather 



Rab{v) = Ra{xi) Rb{xi) , 



(90) 
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Fig. 15. Nuclear shadowing for open charm production in minimal bias gold-gold col- 
lision. Dotted curves show the net effect of gluon shadowing, while solid curves in- 
clude both effects of gluon shadowing and the higher twist correction related to the 
nonzero separation of the cc. The top (RHIC) and bottom (LHC) curves correspond 
to^~s~= 200 GeV and 5500 GeV respectively. 



large, and no gluon shadowing would be expected for DIS [29]. However, the 
process of charm production demonstrates a precocious onset of gluon shadow- 
ing as was discussed above. Besides, the nuclear suppression is squared in AA 
collisions. 

Another interesting observation made in Ref. [4] is that shadowing is the same 
for central and minimal bias events. This has indeed been observed (within large 
error bars) by the PHENIX experiment [66]. 

8 The light-cone dipole formalism for charmonium 
production off a nucleon 

The important advantage of the light-cone (LC) dipole approach is its simplicity 
in the calculations of nuclear effects. It has been suggested two decades ago 
[13] that quark configurations (dipoles) with fixed transverse separations are the 
eigenstates of interaction in QCD. Therefore the amplitude of interaction with 
a nucleon is subject to eikonalization in the case of a nuclear target. In this way 
one effectively sums the Gribov's inelastic corrections in all orders. 

Assuming that the produced cc pair is sufficiently small so that multigluon 
vertices can be neglected, we can write the cross section for G N — > \ X) as ( see 
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Fig. 16. Perturbative QCD mechanism of production of the \ states in a gluon-nucleon 
collision. 



Fig. 16), 

a(GN - X X) = 



2 - 1) z - 



2(JV* - 1) 



" " T a s {k$)F{x,k%) M ab (k T ) 2 



(91) 



where !F(x, k^) = dG(x, fc§,)/d(fc§>) is the unintegrated gluon density, G(x, fcf,) = 
xg(x, fc|i) (x = M^/s); M a b{k,T) is the fusion amplitude GG — > \ with a, b being 
the gluonic indices. 

In the rest frame of the nucleon the amplitude can be represented in terms 
of the cc LC wave functions of the projectile gluon and ejectile charmonium, 

l 

M ab (k T ) = ^=fda Jd 2 rJ2 (*£"(»•><*))* [e < * T ' ri ~ e** 3 "' 2 ] , 

q MM 

(92) 



where 



(1 — a) r, 



r 2 



(93) 



For the sake of simplicity, we separate the color parts (cc, {8} a | and (cc, {1}| 
from the LC wave function of the gluon and charmonium respectively, and cal- 
culate the matrix element, 



(cc, {8} a 



1 



A; 



cc,{l} 



Sgb 



(94) 



which is shown explicitly in Eq. (92). Thus, the functions <P^f^(r, a) in Eq. (92) 
represent only the spin- and coordinate dependent parts of the corresponding 
full wave functions. 

The gluon wave function differs only by a factor from the photon one, 



where is the c-quark spinor, and 



6 = m c a ■ e + i(l - 2a) (er • n) (e • V) + (e x n) V , 



(95) 



(96) 
(97) 
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c > 



(98) 



dr 



The gluon has virtuality Q 2 and polarization vector e and is moving along the 
unit vector n (in what follows we consider only transversely polarized gluons, 
e- n = 0). 

The expression for the LC wave function of a charmonium and the wavefunc- 
tion of the charmonium in its rest frame are related in a somewhat complicated 
way by Lorentz transformation, as discussed in sect. 4. This complexity is a 
consequence of the nonlocal relation between the LC variables (r, a) and the 
components of the 3-dimcnsional relative cc radius-vector in the rest frame of 
the charmonium. Also the Melosh spin rotation leads to a nontrivial relations 
between the two wave functions (see e.g. in [1]). This is a relativistic effect, it 
vanishes in the limit of small velocity v — > of the quarks in the charmonium 
rest frame. 

A word of caution is in order. In some cases the Melosh spin rotation is 
important even in the limit of vanishing quark velocity v — > 0. An example is 
the Landau- Yang theorem [91] which forbids production of the xi state by two 
massless gluons. However, the LC approach leads to creation of the xi even in 
the limit v — > if the effect of spin rotation is neglected. It is demonstrated 
in Ref. [2] that the Landau- Yang theorem is restored only if the Melosh spin 
rotation is included. Such a cancelation of large values is a kind of fine tuning 
and is a good support for the procedure of Lorentz boosting which we apply to 
the charmonium wave functions. 

Since the gluon LC wave function smoothly depends on a while the charmo- 
nium wave function peaks at a = 1/2 with a tiny width estimated in Ref. [2], 
((a — 1/2) 2 ) = 0.01, we can replace the charmonium wave function in the matrix 
element in Eq. (92) with 



da#£"(r, a) 



(99) 



It is convenient to expand the LC charmonium wave function in powers of 
v. The result depends on the total momentum J and its projection J z on the 
direction n. The charmonium wave function integrated over a has the form, 



Jda<P^(r,a) = 



er • e± H (e± x n) ■ V 

m 



2m; 



(e± ■ V) (a ■ V) 



W + 0(v 4 ) 



where 



W = 



e± • r 



R(r) + -^R"(r)+0(v 4 ) 

4 TO? 



(100) 



(101) 



and R(r) is the radial part of the P-wave charmonium in its rest frame (see 
derivation in Appendix A of [2]). The new notations for the polarization vectors 
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are, 



c -'-~ ,e " (102) 



V2 ' 

In what follows we use the LC wave functions of gluons and charmonium 
in order to calculate matrix elements of operators which depend only on the 
LC variables r and a. Therefore, for the sake of simplicity we can drop off the 
indexes jj,, jl and summation over them, i.e. replace 

Y^(®x ( r >«))**G A ( r >«) *£( r > a )«Mr, a) (103) 
up 

With this convention we can rewrite the cross section Eq. (92) as, 

l l 

a(GN -> X X) = j da j da' J d 2 rd 2 r' 
o o 

x {$* x (r,a)$ x (r',a')Z tr (r,r',a,a')$ G (r,a)$* G (r',a')} , (104) 



where the transition cross section S tr is a combination of dipole cross sections, 

(105) 



S tr (r,r',a,a') = \crqq{ri-r! 1 )+a q q{r2-r[)-a q q{r l -r[)-a q q{r2-r! 1 ) 



16 

and n, rJ, r' x and r' 2 are defined like in Eq. (93). 



9 Charmonium hadroproduction off nuclei 

Nuclear effects in charmonium production have drawn much attention during 
the last two decades since the NA3 experiment at CERN [92] has found a steep 
increase of nuclear suppression with rising Feynman xf- This effect has been 
confirmed later in the same energy range [93], and at higher energy recently by 
the most precise experiment E866 at Fermilab [94] . No unambiguous explanation 
for these observations has been provided yet. With the advent of RHIC new 
data are expected soon in the unexplored energy range. Lacking a satisfactory 
understanding of nuclear effects for charmonium production in proton-nucleus 
collisions it is very difficult to provide a convincing interpretation of data from 
heavy ion collisions experiments [95,96] which are aimed to detect the creation of 
a quark-gluon plasma using charmonium as a sensitive probe. Many of existing 
analyses rely on an oversimplified dynamics of charmonium production which fail 
to explain even data for pA collisions, in particular the observed Xf dependence 
of J/<F suppression. Moreover, sometimes even predictions for RHIC employ 
those simple models. It is our purpose to demonstrate that the dynamics of 
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charmonium suppression strikingly changes between the SPS and RHIC energies. 
We perform full QCD calculations of nuclear effects within the framework of the 
light-cone Green function approach aiming to explain observed nuclear effects 
without adjusting any parameters, and to provide realistic predictions for RHIC. 

To avoid a confusion, we should make it clear that we will skip discussion of 
any mechanisms of charmonium suppression caused by the interaction with the 
produced comoving matter, although it should be an important effect in central 
heavy ion collisions. Instead, we consider suppression which originates from the 
production process and propagation of the cc pair through the nucleus. It serves 
as a baseline for search for new physics in heavy ion collisions. 

We focus here on coherence phenomena which are still a rather small correc- 
tion for charmonium production at the SPS, but whose onset has already been 
observed at Fermilab and which are expected to become a dominant effect at the 
energies of RHIC and LHC. One realizes the importance of the coherence effects 
treating charmonium production in an intuitive way as a hard cc fluctuation 
that loses coherence with the projectile ensemble of partons via interaction with 
the target, and is thus liberated. In spite of the hardness of the fluctuation, its 
lifetime in the target rest frame increases with energy and eventually exceeds 
the nucleus size. Apparently, in this case the cc pair is freed by interaction with 
the whole nucleus, rather than with an individual bound nucleon as it happens 
at low energies. Correspondingly, nuclear effects become stronger at high ener- 
gies since the fluctuation propagates through the whole nucleus, and different 
nucleons compete with each other in freeing the cc. In terms of the conventional 
Glauber approach it leads to shadowing. In terms of the parton model it is anal- 
ogous to shadowing of c-quarks in the nuclear structure function. It turns out 
(see Sect. 9.3) that the fluctuations containing gluons in addition to the cc pair 
are subject to especially strong shadowing. Since at high energies the weight of 
such fluctuations rises, as well as the fluctuation lifetime, it becomes the main 
source of nuclear suppression of open and hidden charm at high energies, in par- 
ticular at RHIC. In terms of the parton model, shadowing for such fluctuations 
containing gluons correspond to gluon shadowing. 

The parton model interpretation of charmonium production contains no ex- 
plicit coherence effects, but they are hidden in the gluon distribution function 
of the nucleus which is supposed to be subject to QCD factorization. There are, 
however, a few pitfalls on this way. First of all, factorization is exact only in 
the limit of a very hard scale. That means that one should neglect the effects of 
the order of the inverse c-quark mass, in particular the transverse cc separation 
(r 2 ) ~ I /m 2 . However, shadowing and absorption of cc fluctuations is a source of 
a strong suppression which is nearly factor of 0.5 for heavy nuclei (see Fig. 18). 
QCD factorization misses this effect. Second of all, according to factorization 
gluon shadowing is supposed to be universal, i.e. one can borrow it from an- 
other process (although we still have no experimental information about gluons 
shadowing, it only can be calculated) and use to predict nuclear suppression of 
open or hidden charm. Again, factorization turns out to be dramatically violated 
at the scale of charm and gluon shadowing for charmonium production is much 
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stronger than it is for open charm or deep-inelastic scattering (DIS) (compare 
gluon shadowing exposed in Fig. 21 with one calculated in Ref. [29] for DIS). All 
these important, sometimes dominant effects arc missed by QCD factorization. 
This fact once again emphasizes the advantage of the light-cone dipole approach 
which does reproduce QCD factorization in the limit where it is expected to 
work, and which is also able to calculate the deviations from factorization in a 
parameter free way. 

Unfortunately, none of the existing models for J/\P or production in NN 
collisions is fully successful in describing all the features observed experimen- 
tally. In particular, the 9' and xi production cross sections in NN col- 
lisions come out too small by at least an order of magnitude [97]. Only data 
for production of \i whose mechanism is rather simple seems to be in good 
accord with the theoretical expectation based on the color singlet mechanism 
(CSM) [98,99] treating \2 production via glue-glue fusion. The contribution of 
the color-octet mechanism is an order of magnitude less that of CSM [99] , and is 
even more suppressed according to Ref. [100]. The simplicity of the production 
mechanism of \2 suggests to use this process as a basis for the study of nuclear 
effects. Besides, about 40% of the J/tf's have their origin in \ decays. We drop 
the subscript of \i m what follows unless otherwise specified. 

9.1 Interplay of formation and coherence time scales and related 
phenomena 

A lot of work has been done and considerable progress has been achieved in the 
understanding of many phenomena related to the dynamics of the charmonium 
production and nuclear suppression. 

• Relative nuclear suppression of J/<P and has attracted much attention. 
The has twice as large a radius as the J/tf', therefore should attenuate in 
nuclear matter much stronger. However, formation of the wave function of the 
charmonia takes time, one cannot instantaneously distinguish between these two 
levels. This time interval or so called formation time (length) is enlarged at high 
energy Eq, by Lorentz time dilation, 

*' = M 2 2 -M* ' (1 ° 6) 

and may become comparable to or even longer than the nuclear radius. In this 
case neither J/&, nor propagates through the nuclear medium, but a pre- 
formed cc wave packet [23]. Intuitively, one might even expect a universal nu- 
clear suppression, indeed supported by data [77,95,94]. However, a deeper insight 
shows that such a point of view is oversimplified, namely, the mean transverse 
size of the cc wave packet propagating through the nucleus varies depending on 
the wave function of the final meson on which the cc is projected. In particular, 
the nodal structure of the 2S state substantially enhances the yield of W [33,39] 
(see in [101,102] a complementary interpretation in the hadronic basis). 

• The next phenomenon is related to the so called coherence time. Production 
of a heavy cc is associated with a longitudinal momentum transfer q c which 
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decreases with energy. Therefore the production amplitudes on different nucleons 
add up coherently and interfere if the production points are within the interval 
l c = 1 jq c called coherence length or time, 

This time interval is much shorter than the formation time Eq. (106). One can 
also interpret it in terms of the uncertainty principle as the mean lifetime of 
a cc fluctuation. If the coherence time is long compared to the nuclear radius, 
t c > Ra, different nucleons compete with each other in producing the charmo- 
nium. Therefore, the amplitudes interfere destructively leading to an additional 
suppression called shadowing. Predicted in Rcf. [33], this effect was confirmed 
by the NMC measurements of exclusive J/& photoproduction off nuclei [76] (see 
also Ref. [39]). The recent precise data from the HERMES experiment [103] for 
electroproduction of p mesons also confirms the strong effect of coherence time 
[104]. 

Note that the coherence time Eq. (107) is relevant only for the lightest fluc- 
tuations |cc). Heavier ones which contain additional gluons have shorter lifetime. 
However, at high energies they are also at work and become an important source 
of an extra suppression (see Ref. [29] and Sect. 9.3). They correspond to shad- 
owing of gluons in terms of parton model. In terms of the dual parton model the 
higher Fock states contain additional qq pairs instead of gluons. Their contribu- 
tion is enhanced on a nuclear target and leads to softening of the x p distribution 
of the produced charmonium. This mechanism has been used in Ref. [105] to ex- 
plain the x f dependence of charmonium suppression. However the approach was 
phcnomcnological and data were fitted. 

The first attempt to implement the coherence time effects into the dynamics 
of charmonium production off nuclei has been made in Ref. [106]. However, the 
approach still was phenomenological and data also were fitted. Besides, gluon 
shadowing (see Sect. 9.3) had been missed. 

• The total J/if'-nucleon cross section steeply rises with energy, approxi- 
mately as s - 2 . This behavior is suggested by the observation of a steep energy 
dependence of the cross section of J /& photoproduction at HERA. This fact 
goes well along with observation of the strong correlation between XBj depen- 
dence of the proton structure function at small XBj and the photon virtuality 
Q 2 : the larger is Q 2 (the smaller is its qq fluctuation), the steeper the rises 
F2(xBj,Q 2 ) with 1/xsj- Apparently, the cross section of a small size charmo- 
nium must rise with energy faster than what is known for light hadrons. The 
J/if'-nucleon cross section has been calculated recently in Ref. [1] employing the 
light-cone dipole phenomenology, realistic charmonium wave functions and phe- 
nomenological dipole cross section fitted to data for F 2 (x, Q 2 ) from HERA. The 
results are in a good accord with data for the electroproduction cross sections of 
Jj^f and and also confirm the steep energy dependence of the charmonium- 
nucleon cross sections (see sect. 4). Knowledge of these cross sections is very 
important for the understanding of nuclear effects in the production of char- 
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monia. A new important observation made in Ref. [1] is a strong effect of spin 
rotation associated with boosting the cc system from its rest frame to the light 
cone. It substantially increases the J/\P and especially photoproduction cross 
sections. The effect of spin rotation is also implemented in our calculations below 
and it is crucial for restoration of the Landau- Yang theorem [2,91]. 

• Initial state energy loss by partons traveling through the nucleus affects 
the xf distribution of produced charmonia [107] especially at medium high en- 
ergies. A shift in the effective value of xi, which is the fraction of the incident 
momentum carried by the produced charmonium, and the steep xi-dependence 
of the cross section of charmonium production off a nucleon lead to a dramatic 
nuclear suppression at large x\ (or xf) in a good agreement with data [92,93]. 
The recent analyses [90] of data from the E772 experiment for Drell-Yan process 
on nuclei reveals for the first time a nonzero and rather large energy loss. 

9.2 Higher twist nuclear effects 

Nuclear effects in the production of a x are controlled by the coherence and 
formation lengths which are defined in Eqs. (106), (107). One can identify two 
limiting cases. The first one corresponds to the situation where both l c and If 
are shorter that the mean spacing between bound nucleons. In this case one can 
treat the process classically, the charmonium is produced on one nucleon inside 
the nucleus and attenuates exponentially with an absorptive cross section which 
is the inelastic x — A one. This simplest case is described in Refs. [107,11]. 

In the limit of a very long coherence length l c 3> Ra one can think about a cc 
fluctuation which emerges inside the incident hadron long before the interaction 
with the nucleus. Different bound nucleons compete and shadow each other in 
the process of liberation of this fluctuation. This causes an additional attenuation 
in addition to inelastic collisions of the produced color-singlet cc pair on its way 
out of the nucleus. Since l c <C If an intermediate case is also possible where l c is 
shorter than the mean intcrnuclcon separation, while I f is of the order or longer 
than the nuclear radius. 

The transition between the limits of very short and very long coherence 
lengths is performed using the prescription suggested in Ref. [51] for inelastic 
photoproduction of J/'P off nuclei. The amplitude of x production off a nucleus 
can be represented in the form, 

l 

A^\b,z) = J da J d 2 r J d 2 r'$* x (r,a)D (x \r,r' ,a;b,z)(p G (r',a), (108) 
o 

where D^ x \r, r ', a; b, z) is the amplitude of production of a colorless cc pair 
which reaches a separation r outside the nucleus. It is produced at the point 
(b,z) by a color-octet cc with separation r'. The amplitude consists of two 
terms, 

D (X) (r,r',a;b,z) = D (X) (r,r' ,a;b, z) + D [ 2 X) (r,r' , a;b, z) . (109) 
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a b 

Fig. 17. The incident gluon can either produce the colorless cc pair with quantum 
numbers of x a t the point z (a), or it produces diffractively a color-octet cc with the 
quantum numbers of the gluon at the point zi which is then converted into a color 
singlet state at z (b). Propagation of a color-singlet or octet cc is described by the 
Green functions G^J and G^f , respectively. 



Here the first term reads, 

D{ X) (r, r ', a; b, z) = G%) (r,z+;r',z)e ^ ■ d' e l ^ LZ 



(110) 



where G 1 ^) (r, z + ;r' , z) is the color-singlet Green function describing evolution 
of a cc wave packet with initial separation r ' at the point z up to the final 
separation r at z + — > oo. This term is illustrated in Fig. 17a. 

There is also a possibility for the projectile gluon to experience diffractive 
interaction with production of color-octet cc with the same quantum numbers 
of the gluon at the point Z\ . This pair propagates from the point Z\ to z as is 
described by the corresponding color-octet Green function and produces 
the final colorless pair which propagation is described by the color-singlet Green 
function, as is illustrated in Fig. 17b. The corresponding second term in Eq. (109) 
reads, 



Di X) (r,r ',a;b, z) 



1 



dz! d 2 r" G ( ^(r,z + ;r",z) 



(111) 



x e^ A) • d" G%\r", z;r', z ± ) e iqLZl a q?G (r ' , a) p A (b, zi) . 

The singlet, G^ , and octet, G^l , Green functions describe the propagation 
of color-singlet and octet cc, respectively, in the nuclear medium. They satisfy 
the Schrodinger equations, 



a z 



2E G a{\ - a) 
with k = 1, 8 and boundary conditions 

@c5 ( r : r 'l Z : z ') 



+ V (k) (r,a) 



6(r-r') 



G^(r,r';z,z') , (112) 



(113) 
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The imaginary part of the LC potential is responsible for the attenuation 
in nuclear matter, 

ImV^ (r, a) = -^<jW(r, a) p A (b,z) , (114) 

where 

<7 (1) (r,a) = a q q(r) , 

cr (8) (r,a) = a 3 (r,a) . (115) 

The real part of the LC potential V^ k \r, a) describes the interaction inside 
the cc system. For the singlet state Re V^'(r, a) should be chosen to reproduce 
the charmonium mass spectrum. With a realistic potential (see e.g. Rcf. [1]) 
one can solve Eq. (112) only numerically. Since we focus here on the principle 
problems of understanding of the dynamics of nuclear shadowing in charmonium 
production, we chose the oscillator form of the potential [29], 

ReV (1 Hr a) = - (116) 

where 



a(a) = 2 y/a{\ - a) , (117) 
p 2 

The LC potential Eq. (116) corresponds to a choice of a potential, 

U{R) = ^ujR 2 , (118) 

in the nonrelativistic Schrodingcr equation, 

A 



2, ' U W 



&(R) = EV{r) , (119) 



which should describe the bound states of a colorless cc system. Of course this 
is an approximation we are forced to do in order to solve the evolution equation 
analytically. 

To describe color-octet cc pairs we fix the corresponding potential at 

RcV (8) (r,a) = , (120) 

in order to reproduce the gluon wave function Eq. (95). 

To keep calculations simple we use the r 2 -approximation Eq. (17) for the 
dipole cross section which is reasonable for small-size heavy quark systems. Then, 
taking into account Eqs. (114) - (116) we arrive at the final expressions, 



V^{r,a)= l -n^r 2 , 



(121) 
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* (1) = „ ri ° ( °L -iC(s) PA , (122) 
a(l — a) he 

= - lC { S ) PA ^-[o? + {l-af]- 1 ^ . (123) 

Making use of this approximation and assuming a constant nuclear density 
pA {b, z) = pa the Green functions can be obtained in an analytical form, 

nWf > \ h(k) 
Gcc {r,r ;z 2 ,zi) 



2ir sinh(!7( fc ) Az) 

f M fc ) r r 2 +r' 2 2r r' 11 

XCXP \ 2 [tanh(J?( fc Mz) sinh(/2« A?) J J ( } 



where 



b {k) = y'kW E G a(l-a) 

i?G a(l - a) 
Az = z 2 — zi . 



We define the nuclear transparency for \ production 



as 



It depends only on the x or projectile gluon energy. We plot our predictions for 
lead in Fig. 18. 

Transparency rises at low energy since the formation length increases and the 
effective absorption cross section becomes smaller. This behavior, assuming l c = 
0, is shown by dashed curve. However, at higher energies the coherence length 
is switched on and shadowing adds to absorption. As a result, transparency 
decreases, as is shown by the solid curve. On top of that, the energy dependence 
of the dipole cross section makes those both curves for Tta{E x ) fall even faster. 

Apparently, the nuclear transparency depends only on the \ ener gy ; rather 
than the incident energy or x\. It is interesting that this leads to x 2 scaling. 
Indeed, the \ energy 

M 2 

E x - 7r~^- . ( 126 ) 
2 tun X2 

depends only on xi- We show the x 2 scale in Fig. 18 (top) along with energy 
dependence. 

We also compare in Fig. 19 the contribution of quark shadowing and absorp- 
tion (thin solid curve) with the nuclear suppression observed at 800 GeV [94]. 
Since data are for W/Be ratio, and our constant density approximation should 
not be applied to beryllium, we assume for simplicity that all pA cross sections 
including pN obey the A a ( XF \ We see that the calculated contribution has quite 
a different shape from what is suggested by the data. It also leaves plenty of room 
for complementary mechanisms of suppression at large xf (see below). 
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Fig. 18. Nuclear transparency for \ production off lead as function of energy of the 
charmonium, or X2 (the upper scale). The solid curve includes both effects of coherence 
and formation, while the dashed curve corresponds to l c = 0. Since transparency scales 
in X2 according to (126), values of X2 are shown on the top axis. 



9.3 Leading twist gluon shadowing 

Previously we considered only the lowest |cc) fluctuation of the gluon, which 
is apparently an approximation. The higher Fock components containing gluons 
should be also included. In fact they are already incorporated in the phenomeno- 
logical dipole cross section we use, and give rise to the energy dependence of <r q q. 
However, they are still excluded from nuclear effects. Indeed, although we eikon- 
alize the energy dependent dipole cross section the higher Fock components do 
not participate in that procedure, but they have to be eikonalized as well. This 
corrections, as is demonstrated below, correspond to suppression of gluon density 
in nuclei at small x. 

The gluon density at small x in nuclei is known to be shadowed, i.e. reduced 
compared to a free nucleons. The partonic interpretation of this phenomenon 
looks very different depending on the reference frame. In the infinite momentum 
frame, as was first suggested by Kanchcli [108], the partonic clouds of nucleons 
are squeezed by the Lorentz transformation less at small than at large x. There- 
fore, while these clouds are well separated in longitudinal direction at large x, 
they overlap and can fuse at small x, resulting in a diminished parton density 



Different observables can probe this effect. Nuclear shadowing of the DIS 
inclusive cross section or Drell-Yan process demonstrate a reduction of the sea 
quark density at small x. Charmonium or open charm production is usually 
considered as a probe for gluon distribution. 



[108,9]. 
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Fig. 19. Tungsten to beryllium cross section ratio as function of Feynman xf for J/\P 
production at proton energy 800 GeV. The thin solid curve represents contribution 
of initial state quark shadowing and final state cc attenuation for \ production. The 
dotted curve includes also gluon shadowing. The dashed curve is corrected for gluon 
enhancement at large X2 (small xf) using the prescription from [78]. The final solid 
curve is also corrected for energy loss and for x — ► J/^J decay. Experimental points 
are from the E866 experiment [94]. 



Although observables are Lorentz invariant, partonic interpretations are not, 
and the mechanism of shadowing looks quite different in the rest frame of the 
nucleus where it should be treated as Gribov's inelastic shadowing. This ap- 
proach seems to go better along with our intuition, besides, the interference or 
coherence length effects governing shadowing are under a better control. One can 
even calculate shadowing in this reference frame in a parameter free way (see 
Refs. [58,83,29]) employing the well developed phenomenology of color dipole 
representation suggested in Ref. [13]. On the other hand, within the parton 
model one can only calculate the Q 2 evolution of shadowing which is quite a 
weak effect. The main contribution to shadowing originates from the fitted to 
data input. 

In the color dipole representation nuclear shadowing can be calculated via 
simple eikonalization of the elastic amplitude for each Fock component of the 
projectile light-cone wave function which are the eigenstates of interaction [13]. 
Different Fock components represent shadowing of different species of partons. 
The \qq) component in DIS or |q , 7*} m Drell-Yan reaction should be used to 
calculate shadowing of sea quarks. The same components including also one or 
more gluons lead to gluon shadowing [88,29]. 
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Fig. 20. The dominant Feynman diagrams contributing to \ production. 

In the color dipole approach one can explicitly see deviations from QCD fac- 
torization, i.e. dependence of the measured parton distribution on the process 
measuring it. For example, the coherence length and nuclear shadowing in the 
Drell-Yan process vanish at minimal X2 (at fixed energy) [90], while the factoriza- 
tion predicts maximal shadowing. Here we present even more striking deviation 
from factorization, namely, gluon shadowing for charmonium production turns 
out to be dramatically enhanced compared to DIS. 

9.4 LC dipole representation for the reaction GN — ► xGX 

In the case of charmonium production, different Fock components of the projec- 
tile gluon, \{cc)\nG) containing a colorless cc pair and n gluons (n = 0, 1 . . .) 
build up the cross section of charmonium production which steeply rises with en- 
ergy (see Ref. [1]). The cross section is expected to factorize in impact parameter 
representation in analogy to the DIS and Drell Yan reaction. This representa- 
tion has the essential advantage in that nuclear effects can be easily calculated 
[15,83]. Feynman diagrams corresponding \ production associated with gluon 
radiation are shown in Appendix D of [2]. We treat the interaction of heavy 
quarks perturbatively in the lowest order approximation, while the interaction 
with the nucleon is soft and expressed in terms of the gluon distribution. The 
calculations are substantially simplified if the radiated gluon takes a vanishing 
fraction 03 of the total light-cone momentum and the heavy quarkonium can 
be treated as a nonrelativistic system. In this case the amplitude of \ G pro- 
duction has a simple form that corresponds to the "Drell-Yan" mechanism of \ 
production illustrated in Fig. 20. 

Correspondingly, the cross section of x production has the familiar factorized 
form similar to the Drell-Yan reaction [15,82,83], 



where uqg (?"> x) = 9/4 <J q q(r, x) is the cross section of interaction of a G G dipole 
with a nucleon. ^(s, 0:3) is the effective distribution amplitude for the \ — G 
fluctuation of a gluon, which is the analog to the 7* q fluctuation of a quark, 




(127) 




(128) 
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Here, <P£ M (r, a) and <l>^f(r, a) are the qq LC wave functions of the \ and gluon, 
respectively, which depend on transverse separation r and relative sharing a 
by the qq of the total LC momentum. $ c c{s,a) is the LC wave function of a 
quark-gluon Fock component of a quark. 



9.5 Gluon shadowing for \ production off nuclei 

The gluon density in nuclei is known to be modified, shadowed at small Bjorken 
x. Correspondingly, production of \ treated as gluon-gluon fusion must be ad- 
ditionally suppressed. In the rest frame of the nucleus, gluon shadowing appears 
as Gribov's inelastic shadowing [57], which is related to diffractive gluon radia- 
tion. The rest frame seems to be more convenient to calculate gluon shadowing, 
since techniques are better developed, and we use it in what follows. The process 
G N — > x X considered in the previous section includes by default radiation of 
any number of gluons which give rise to the energy dependence of the dipole 
cross section. 

Extending the analogy between the reactions of \ G production by an inci- 
dent gluon and heavy photon radiation by a quark to the case of nuclear target 
one can write an expression for the cross section of reaction GA — > xG X in 
two limiting cases: 

(i) the production occurs nearly instantaneously over a longitudinal distance 
which is much shorter than the mean free path of the \ G P a i r m nuclear matter. 
In this case the cross sections on a nuclear and nucleon targets differ by a factor 
A independently of the dynamics of x G production. 

(ii) The lifetime of the \ G fluctuation, 

to = W , (129) 

M XG 

substantially exceeds the nuclear size. It is straightforward to replace the dipole 
cross section on a nucleon by a nuclear one [15,83], then Eq. (127) is modified to 



da(GA -» X GX) 
rf(lna 3 ) 



2 / d 2 bd 2 s \$ Gx (a,a 3 )\' 



1 — cxp 



^<?GG{s,x 2 /a 3 )T A (b) 



(130) 



In order to single out the net gluon shadowing we exclude here the size of the 
cc pair assuming that the cross section responsible for shadowing depends only 
on the transverse separation s. 

(iii) A general solution valid for any value of t c is more complicated and 
must interpolate between the above limiting situations. In this case one can 
use the methods of the Landau-Pomeranchuk-Migdal (LPM) theory for photon 
bremsstrahlung in a medium generalized for targets of finite thickness in [109,83]. 
The general expressions for the cross section which reproduces the limiting cases 
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t c — > (i) and t c — > oo (ii) reads, 




x j d 2 s |^ Gx (s,a 3 )| 2 a GG [(1 - a 3 )s,x 2 /a 3 ] 

OO Z2 

- ^Rc y dz 2/M (6,z 2 ) y rf^pA^^O^^Oe^^-^ I , (131) 

where 



£{z 2 ,zi) = j d sid s 2 & Gx (s 2 , a 3 ) a GG (s 2 , x 2 /a 3 ) G{s 2 , z 2 ; s 1 , z x ) 

x a GG (s ll x 2 /a 3 )1> Gx {s 1 ,a 3 ) . (132) 

To single out the correction for gluon shadowing one should compare the cross 
section Eq. (131) with the impulse approximation term in which absorption is 
suppressed, 



Rg{x 2 ) 



G a (x 2 ) _ 1 f j da(GA^ x GX) 



J da 3 



AG N {x 2 ) Aa(GN^ x X) 

For further calculations and many other applications one needs to know gluon 
shadowing as function of impact parameter which is calculated as follows, 

G A {x 2 ,b) 



T A {b) G N (x 2 ) 



1 f , da(GA — » xGX) ,, oj , 
' d ^ -■ (134) 



T A (b) a(GN ^ X X) J d 2 bda 3 



X2 



The results of calculations for the 6-dependence of gluon shadowing (134) are 
depicted in Fig. 21 for different values of x 2 as function of thickness of nuclear 
matter, L = \J R 2 A — b 2 . 

The results confirm the obvious expectation that shadowing increases for 
smaller x 2 and for longer path in nuclear matter. One can see that for given 
thickness shadowing tends to saturate down to small x 2 , what might be a re- 
sult of one gluon approximation. Higher Fock components with larger number of 
gluons are switched on at very small x 2 . At the same time, shadowing saturates 
at large lengths what one should have also expected as a manifestation of gluon 
saturation. Note that at large x 2 = 0.03 shadowing is even getting weaker at 
longer L. This is easy to understand, in the case of weak shadowing one can drop 
off the multiple scattering terms higher than two-fold one. Then the shadowing 
correction is controlled by the longitudinal formfactor of the nucleus which de- 
creases with L (it is obvious for the Gaussian shape of the nuclear density, but 
is also true for the realistic Woods-Saxon distribution). 
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Fig. 21. Gluon suppression as function of thickness of nuclear matter with constant 
density pA = 0.16 /m~ 3 . 



9.6 Antishadowing of gluons 

Nuclear modification of the gluon distribution is poorly known. There is still no 
experimental evidence for that. Nevertheless, the expectation of gluon shadowing 
at small x is very solid, and only its amount might be disputable. At the same 
time, some indications exist that gluons may be enhanced in nuclei at medium 
small x 2 ~ 0.1. The magnitude of gluon antishadowing has been estimated in 
Ref. [45] assuming that the total fraction of momentum carried by gluons is the 
same in nuclei and free nucleons (there is an experimental support for it). Such 
a momentum conservation sum rule leads to a gluon enhancement at medium 
x, since gluons are suppressed in nuclei at small x. The effect, up to ~ 20% 
antishadowing in heavy nuclei at x ss 0.1, found in Ref. [45] is rather large, 
but it is a result of very strong shadowing which we believe has been grossly 
overestimated (see discussion in Ref. [29]). 

Fit to DIS data based on evolution equations performed in Ref. [78] also 
provided an evidence for rather strong antishadowing effect at x ~ 0.1. However, 
the fit employed an ad hoc assumption that gluons are shadowed at the low scale 
Qq exactly as F 2 (x, Q 2 ) what might be true only by accident. Besides, in the x 
distribution of antishadowing was shaped ad hoc too. 

A similar magnitude of antishadowing has been found in the analysis [110] 
of data on Q 2 dependence of nuclear to nucleon ratio of the structure func- 
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tions, F 2 A (x, Q 2 )/F 2 n (x, Q 2 ). However it was based on the leading order QCD 
approximation which is not well justified at these values of Q 2 . 

Although neither of these results seem to be reliable, similarity of the scale 
of the predicted effect looks convincing, and we included the antishadowing of 
gluons in our calculations. We use the shape of x 2 dependence and magnitude 
of gluon enhancement from Ref. [78] . 

9.7 Comparison with available data and predictions for higher 
energies 

The dynamics of J/\P suppression at energy 800 GeV is rather complicated and 
includes many effects. Now we can apply more corrections to the dotted curve in 
Fig. 19 which involves only quark and gluon shadowing. Namely, inclusion of the 
energy loss effect and decay \ Jf&'y leads to a stronger suppression depicted 
by the dashed curve. Eventually we correct this curve for gluon enhancement at 
x 2 ~ 0.1 (small xp) and arrive at the final result shown by thick solid curve. 

Since our calculation contains no free parameters we think that the results 
agree with the data amazingly well. Some difference in the shape of the maximum 
observed and calculated at small Xf may be a result of the used parameteriza- 
tion [78] for gluon antishadowing. We think that it gives only the scale of the 
effect, but neither the ad hoc shape, nor the magnitude should be taken literally. 
Besides, our calculations are relevant only for those J/\Ps which originate from 
X decays which feed only about 40% of the observed ones. 

At higher energies of RH1C and LHC, the effect of energy loss is completely 
gone and nuclear suppression must expose x 2 scaling. Much smaller x 2 can be 
reached at higher energies. Our predictions for proton-gold to proton-proton 
ratio is depicted in Fig. 22. One can see that at xp > 0.1 shadowing suppresses 
charmonium production by nearly an order of magnitude. We can also estimate 
the effect of nuclear suppression in heavy ion collisions assuming factorization, 

Rab{xf) = R p b{xf) R p a(-x f ) • (135) 

Our predictions for gold-gold collisions at y/s = 200 GeV are shown by the 
bottom curve in Fig. 22. Since factorization is violated this prediction should be 
verified. 

10 Summary 

In these lectures, we presented several QCD processes related to production of 
heavy quarks at high energies. We describe all these reactions within the same 
approach, a light-cone color-dipole formalism. We highlighted the main advan- 
tages of this approach in comparison with the alternative description based on 
the standard QCD parton model. The color-dipole formalism does not involve 
any uncertain if-factors, takes care and calculates higher twist corrections, pre- 
dicts nuclear effects. At the same time, this approach is restricted to the small- a: 
domain. 
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Fig. 22. Nuclear suppression of J /$> production in proton-gold collisions at y/s = 
200 GeV as function ofxF (the upper curve) and in gold-gold collisions (bottom curve). 
Effects of quark and gluon shadowing and gluon antishadowing are included. 



We started with the simplest process of dim-active production of charmonia 
off protons and nuclei. We made use of the best of our knowledge for charmonium 
wave functions and methods of their boosting to the light front. As a result, we 
arrived at a very good agreement with data, achieved without any adjustments. 
One of the key issues in reaching this agreement is inclusion of the Melosh spin 
rotation which substantially changes the production rates of J/& and especially 
W . In particular, it solves the long standing problem of understanding photopro- 
duction data for the \P' to J/'P ratio. These calculations also provided realistic 
predictions for charmonium- nucleon total cross sections. 

We extended the study to charmonium photoproduction on nuclear targets 
aiming to study shadowing effects. Surprisingly, we found that higher twist shad- 
owing which is neglected in parton model calculations, is the main source of 
shadowing, at least for foreseen energies. This shadowing effect is related to a 
nonzero separation of the produced cc and vanishes in the limit of very heavy 
quarks. The leading twist shadowing, so called gluon shadowing, is related to 
higher Fock components of the photon containing gluons. It depends only loga- 
rithmically on the quark mass, but its onset is delayed to very high energies. 

The next important process is hadroproduction of open heavy flavor. The 
color-dipole approach turns out to be quite effective even for a proton target due 
to well developed phenomenology for the dipolc cross section fitted to HERA 
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data for F%{x, Q 2 ). Our predictions for open charm and beauty production well 
agrees with available data. 

Higher twist quark shadowing for open charm hadroproduction off nuclei is 
a quite weak effect. However, we find large higher twist corrections to the lead- 
ing twist gluon shadowing, which makes the latter process dependent. Gluon 
shadowing in open charm production is found to be stronger than in photopro- 
duction of charmonium (and in DIS), but somewhat weaker than in the case of 
hadroproduction of charmonium. Our predictions for RHIC will be tested soon. 

The last and most complicated case is hadroproduction of charmonia. We 
restricted ourselves to the simplest case of production of the P-wave x states. 
Like in photoproduction, we found a substantial higher twist shadowing, but 
much stronger leading twist gluon shadowing. For the first time we explained 
the steep xf dependence of nuclear suppression of charmonia observed in the 
E772/866 experiments at Fermilab. Gluon shadowing is dramatically enhanced 
at the energies of RHIC and LHC and we predict very strong suppression of 
charmonia both for pA and A A collisions. 
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